Re: [Bacula-users] Bacula Differential and Incremental Backup not working
Hello Thorsten, On Fri, 21 Apr 2023 09:10:16 +0200 "Dr. Thorsten Brandau" wrote: > Hi > > I am running Bacula with a tape drive on an Autoloader. As the full > Backup takes about 70 h (it is a larger filesystem to backup) I want > to do differential and incremental backups. However, all Differential > and Incremental are performed as full backups. > > I am running also an Rsync script with hardlinks, where it is no > problem to have differential backups. > > It seems as the file checking of Bacula is not correct. > > Any idea how to finetune? Is it possible to understand WHY a file is > considered new? Is there any way to control this? If you are using rsync then the mtime will be set to that of the original file but the ctime will be the time when rsync copied the file. Bacula normally looks at both mtime and ctime to determine if a file has changed. There is a parameter in Bacula to change this behaviour - mtimeonly= If enabled, tells the Client that the selection of - files during Incremental and Differential backups should based only - on the st_mtime value in the stat() packet. The default is no which - means that the selection of files to be backed up will be based on - both the st_mtime and the st_ctime values. In general, it is not - recommended to use this option. Note the caveat at the end of the description. > We have several backup strategies, with Rsync on different computers, > but also symmetric synching with remote hosts. > > Would a blockwise differential backup be possible? > > Or at last ignoring things like ACL or so? > > Thanks > > Cheers > > Thorsten Regards, Richard ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Notifications doesn't work
On Mon, 21 Nov 2022 12:16:24 + Gina Costa wrote: > Hi, > > I’m using bacula 9 over CentOS. I need receive notifications about > job failures but this notifications doesn’t work. The configuration > file bacula-dir.conf has the followup Messages directive: > > *** > Messages { > Name = Standard > mailcommand = "/usr/sbin/bsmtp -h 192.168.0.66 -f "(Bacula) <%r>" -s > "Bacula: %t %e of %c %l" %r" operatorcommand = "/usr/sbin/bsmtp -h > 192.168.0.66 -f "(Bacula) <%r>" -s "Bacula: Intervention needed for > %j" %r" mail = gina.co...@uc.pt = all, !skipped operator = > gina.co...@uc.pt = mount console = all, !skipped, !saved > append = "/var/log/bacula/bacula.log" = all, !skipped > catalog = all > } > *** > > To test whether the mail sending is working as it should, I do the > following command, and this works fine, I receive the test message : > > echo "This is test message." | /opt/bacula/bin/bsmtp -h > 192.168.0.66 -f bac...@uc.pt -s "Test" gina.co...@uc.pt -d 50 > > > Can anyone help me? > > > > Gina Costa Hello Gina, Your paths are different. Your configuration file has /usr/sbin/bsmtp but your test command has /opt/bacula/bin/bsmtp I think you need to change the path in your configuration file (two places) Regards, Richard ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Wich wildcard chars allowed
I am getting ready to implement wilddir on my includes and excludes and am wondering which wild card characters are allowed without using the regex option. I see that the '*' is allowed, but after searching the docs and the Web I can find no mention of which other chars, if any, are also allowed. Is the '?' char allowed? is there a way of specifying a character/numeric range without the regex option? I want to write /var/spool/samba/netdrive/ASA/*/2010-2019 (2010-2019 are directory names, not file names) Is it dependent on the OS? I use GNU with the Linux kernel. I am using Bacula 9.6.7 My Regex skills are rather limited and I prefer to avoid that nightmare if possible. Thanks Richard -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por escrito de LinuxCabal está prohibida. Si usted no es el destinatario a quien se dirige el presente correo, favor de contactar al remitente respondiendo al presente correo y eliminar el correo original incluyendo sus archivos, así como cualesquiera copia del mismo. Mediante la recepción del presente correo usted reconoce y acepta que en caso de incumplimiento de su parte y/o de sus representantes a los términos antes mencionados, LinuxCabal tendrá derecho a los daños y perjuicios que esto le cause. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Wild card expansion
Greetings and happy 2022 to all In my filesets.conf I have a bunch of includes and excludes like File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/2012" File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/2013" File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/2014" File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2012" File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2013" File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2014" File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/2015" Can I write File = "/var/spool/samba/netdrive/ASA/Ventas/Curriculum/201[234] File = "/var/spool/samba/netdrive/ASA/Ventas/Competencia/201[2345] or some such Also in the includes can I write File = "/var/spool/samba/netdrive/home/*/Historical instead of listing each and every one?? Thanks Richard -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por escrito de LinuxCabal está prohibida. Si usted no es el destinatario a quien se dirige el presente correo, favor de contactar al remitente respondiendo al presente correo y eliminar el correo original incluyendo sus archivos, así como cualesquiera copia del mismo. Mediante la recepción del presente correo usted reconoce y acepta que en caso de incumplimiento de su parte y/o de sus representantes a los términos antes mencionados, LinuxCabal tendrá derecho a los daños y perjuicios que esto le cause. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula-fd version
The client bacula-fd is version 7.4.3 (18 June 2016) and the director and storage daemons are version 9.6.7 (10 December 2020) Is that too great a version disparity? Thanks Richard On 12/28/21 18:27, Phil Stracchino wrote: On 12/28/21 18:22, Richard Couture wrote: Does the bacula-fd client version have to be the same or newer than the server version of bacula or does the server version of bacula have to be the same or newer than the bacula-fd client version? my server version is 9.6.7 and the bacula-fd client version on one of the machines is much older How much older is "much older"? Bacula directors and storage daemons should always be the same version. Clients (file daemons) can be older *within reason*, but you may run into problems if the client is *too* old. Is there a reason why that one client cannot be updated? -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por escrito de LinuxCabal está prohibida. Si usted no es el destinatario a quien se dirige el presente correo, favor de contactar al remitente respondiendo al presente correo y eliminar el correo original incluyendo sus archivos, así como cualesquiera copia del mismo. Mediante la recepción del presente correo usted reconoce y acepta que en caso de incumplimiento de su parte y/o de sus representantes a los términos antes mencionados, LinuxCabal tendrá derecho a los daños y perjuicios que esto le cause. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula-fd version
Does the bacula-fd client version have to be the same or newer than the server version of bacula or does the server version of bacula have to be the same or newer than the bacula-fd client version? my server version is 9.6.7 and the bacula-fd client version on one of the machines is much older Thanks Richard -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por escrito de LinuxCabal está prohibida. Si usted no es el destinatario a quien se dirige el presente correo, favor de contactar al remitente respondiendo al presente correo y eliminar el correo original incluyendo sus archivos, así como cualesquiera copia del mismo. Mediante la recepción del presente correo usted reconoce y acepta que en caso de incumplimiento de su parte y/o de sus representantes a los términos antes mencionados, LinuxCabal tendrá derecho a los daños y perjuicios que esto le cause. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Barcodes with Bacula 9.6.7
Greetings I am upgrading (reinstalling) a bacula server configured in 2016 which has been working great all this time, until the machine died... I replaced the backup unit with a Quantum Scalar I3 with a 50 LTO-8 tape capacity magazine I have beaten the mtx-changer into submission and it now works consistently with the bacula 9.6.7 which came with my distro of GNU Linux It appears that this version of bacula uses a very different paradigm... I have never used Scratch or barcodes before. I used to label my tapes manually with a script that I wrote and put them in different pools which were called MondayPool and TeusdayPool ... I have told bconsole to "label barcodes" and place the volumes in Scratch I need to do the same backup job Mon-Fri and a different job for Sat and yet another job for Sun Does that mean that I create a WeekdayPool and a SatPool and a SunPool??? How do I get bacula to use the tapes in scratch properly to accomplish this. Thanks Richard -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por escrito de LinuxCabal está prohibida. Si usted no es el destinatario a quien se dirige el presente correo, favor de contactar al remitente respondiendo al presente correo y eliminar el correo original incluyendo sus archivos, así como cualesquiera copia del mismo. Mediante la recepción del presente correo usted reconoce y acepta que en caso de incumplimiento de su parte y/o de sus representantes a los términos antes mencionados, LinuxCabal tendrá derecho a los daños y perjuicios que esto le cause. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Connect to Director Schedule Not Working
Hello, I am using the Connect To Director feature to backup a system behind a NAT. This system has only intermittent connectivity to the backup server so I am using a schedule to connect only at certain times. The backups are working fine but the connection schedule does not seem to be working. Here is my bacula-fd on the client system Director { Name = backupserver-dir Password = "notmyrealpassword" Address = backupserver Connect To Director = yes Schedule = BackupHours } FileDaemon { Name = client-fd FDAddress = client FDPort = 9102 WorkingDirectory = /var/bacula Pid Directory = /var/run Maximum Concurrent Jobs = 20 } Schedule { Name = BackupHours Connect = MaxConnectTime=1h on thu at 09:45 } >From what I understand, this connection schedule means that this client should try to connect to the director between 09:45 and 10:45 on Thursdays. However, I am seeing errors from the client that it is not able to connect to the directory outside of those hours Nov 25 13:24:52 client bacula-fd: bsockcore.c:266 Unable to connect to Director daemon on backupserver:9101. ERR=Interrupted system call Have I misunderstood this schedule or is my configuration wrong? Regards, Richard ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] mtx-changer problem
Greetings I am upgrading (reinstalling) a bacula server configured in 2016 which has been working great all this time, until the machine died... It appears that the new version of bacula uses a very different paradigm... Am I correct in interpreting the manual to mean that all tapes with a barcode will be labeled and assigned to a scratch pool, from which tapes will be retrieved at the time of backup and reassigned to their appropriate pool, in my case either a Monday pool and a Tuesday pool ... through a Sunday pool??? Now for the problem that I am encountering. I have a quantum Scalar i3 tape changer with an IBM HH08 LTO-8 drive The tape drive is either /dev/st0 or /dev/nst0 depending on if I want to append and the robot is /dev/sg2 The only way that I can get mtx-changer to work, is to issue an mt -f /dev/st0 offline directive before any ./mtx-changer /dev/sg2 {load/unload... Command} $Slot /dev/nst0 0 which takes a great deal of time as the offline command takes more than 30 secs to complete. The GREATER problem is when I issue a label barcodes command from bconsole which then issues the appropriate mtx-changer commands, WITHOUT the offline prior to each command, resulting in one tape being labeled correctly and 47 error messages similar to Label command failed for Volume 04L8. Sending label command for Volume "05L8" Slot 5 ... 3307 Issuing autochanger "unload Volume 02L8, Slot 2, Drive 0" command. 3995 Bad autochanger "unload Volume 02L8, Slot 2, Drive 0": ERR=Child exited with code 1 Results=Unloading drive 0 into Storage Element 2...mtx: Request Sense: Long Report=yes mtx: Request Sense: Valid Residual=no mtx: Request Sense: Error Code=70 (Current) mtx: Request Sense: Sense Key=Illegal Request mtx: Request Sense: FileMark=no mtx: Request Sense: EOM=no mtx: Request Sense: ILI=no mtx: Request Sense: Additional Sense Code = 53 mtx: Request Sense: Additional Sense Qualifier = 01 mtx: Request Sense: Field in Error = 00 mtx: Request Sense: BPV=no mtx: Request Sense: Error in CDB=no mtx: Request Sense: SKSV=yes mtx: Request Sense: Field Pointer = 00 00 MOVE MEDIUM from Element Address 256 to 4097 Failed Can anyone give me a hint as to how to get around this. I can label each tape manually using the commands with judicious use of the offline command, which is NO solution but an indication that I am using the correct mtx-changer command syntax Thanks Richard -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por escrito de LinuxCabal está prohibida. Si usted no es el destinatario a quien se dirige el presente correo, favor de contactar al remitente respondiendo al presente correo y eliminar el correo original incluyendo sus archivos, así como cualesquiera copia del mismo. Mediante la recepción del presente correo usted reconoce y acepta que en caso de incumplimiento de su parte y/o de sus representantes a los términos antes mencionados, LinuxCabal tendrá derecho a los daños y perjuicios que esto le cause. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Running Copy Job Immediately After Disk Backups
Hello, I would like to run a copy job immediately after a set of disk backups has completed, but this seems to not work as I expect. I am scheduling the jobs as follows Client1 - Disk backup - Priority 10 Client2 - Disk backup - Priority 10 Client3 - Disk backup - Priority 10 Client4 - Disk backup - Priority 10 Client5 - Disk backup - Priority 10 and so on for other clients All of these jobs will run in parallel (up to the concurrency limit) Copy Job - Disk to Tape - Priority 20 - Pool Uncopied Jobs. This job should backup all of the just completed disk backups to a tape which goes offsite. This gives both onsite and offsite copies. When I try to implement this, the disk backups all complete successfully, but the copy job does not copy anything to tape. After analysing this I think it is because the copy job looks for jobs to copy as soon as it starts. This means that if it is started at the same time or while any of the disk jobs are running it will copy only the completed ones even thought it does not actually run until all of the disk backups have completed (because it has a lower priority) I could schedule the copy job to start an hour after I expect the latest disk backup to finish but this means that the backups do not complete as early as possible. Is it possible to do one of the following: 1. Delay the selection of jobs for the copy job until it actually runs rather than do the selection when it initially starts 2. Have a job (priority 20) which starts the copy job. This would then start the copy job only when all of the disk backups are complete. 3. Something else that I have not thought of which fixes this issue. Regards, Richard ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] StartupScript - RHat 7
> Date: Thursday, August 22, 2019 03:36:11 +0200 > From: Maurizio Caloro > > Please, me script from Bacula-fd dont run. i see that < > start-stop-daemon > are missing on Redhat > > I bevor use everytime Debain... please any update possible for me > Script ? > With rhel-7, bacula (as with most other) daemons are handled through systemctl, not init.d scripts. You didn't indicate what version of bacula you have installed, where you got it from or how you installed it, but I would assume that the necessary systemctl service files were likely included and installed. You can use systemctl commands to check for that. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to LTO-8
The SAS controller was working with an IBM library with LTO-4 with another computer running bacula 5.xxx. When the IBM died we decided that it was time to upgrade rather than repair as the LTO-4 was no longer large enough to backup everything. We never really looked into whether it was the HBA or the library of both... I noted when connecting the new library to the HBA that it hung at boot for 3 - 5 minutes before continuing, which gave me pause, but it finally continued without displaying any error. I reset the HBA to factory as well as changing many settings like not trying to boot and with each change the HBA hung at boot for a LONG time, so I am somewhat suspicious of the HBA. Richard On 1/11/19 6:27 PM, Adam Nielsen wrote: I found another person with the very same symptoms and they resolved the problem by changing out the SAS host adapter Wow that's weird that a SAS controller would be to blame! My library and drive are HP and they supply "HP Tape Tools" which you can use to run tests on the library (and drive) to see if they are working properly. Are there any vendor diagnostics for your library that you could run to confirm it is working correctly? It seems a bit odd it would be the SAS controller if it worked before upgrading to the latest Bacula version. Perhaps it's an issue with a kernel driver, assuming you upgraded the whole OS at the same time? I Note that both my bacula-dir and my bacula-sd conf files have a Storage section, with a Device section only in bacula-sd. Is this correct or should the Storage and Device be in one or the other confs? If they or one or the other sections should be in both confs, should they be identical??? This is correct. The entries in bacula-dir tell it to connect to the bacula-sd daemon, and the entries in bacula-sd tell it which hardware device to use. This is because you can have multiple bacula-sd instances on different machines, so the Director needs to know which device is controlled by which machine. You should have both the autochanger and the drive listed in both config files, however the one listed in bacula-dir.conf will be much shorter as it won't have any of the configuration, basically just the password for the bacula-sd daemon. I am not sure whether it is necessary to list both the drive and the autochanger (from your config files it looks like you only include the autochanger and not the drive) but since Bacula is calling the mtx-changer script it would seem to be fine the way you have it now. In case it's helpful, here are the full Storage sections from my own bacula-dir.conf: Autochanger { Name = peapod-x Address = localhost SDPort = 9103 Password = "xxx" Device = peapod-x Media Type = LTO-4 Maximum Concurrent Jobs = 10 } Storage { Name = peapod-d1 Address = localhost SDPort = 9103 Password = "xxx" Device = peapod-d1 Media Type = LTO-4 Autochanger = peapod-x Maximum Concurrent Jobs = 10 } Your Storage section with "Autochanger = yes" is equivalent to the Autochanger section, this is just a newer way of writing it that works with recent Bacula versions. (Definitely 9.x, not sure about 7.x though.) Cheers, Adam. -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por escrito de LinuxCabal está prohibida. Si usted no es el destinatario a quien se dirige el presente correo, favor de contactar al remitente respondiendo al presente correo y eliminar el correo original incluyendo sus archivos, así como cualesquiera copia del mismo. Mediante la recepción del presente correo usted reconoce y acepta que en caso de incumplimiento de su parte y/o de sus representantes a los términos antes mencionados, LinuxCabal tendrá derecho a los daños y perjuicios que esto le cause. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] mtx and mtx-changer not functioning
Here is my lsscsi -g I use sg3 to talk to the magazine mech and st0 or nst0 to talk to the drive I don't have a /dev/changer as many seem to have In /dev/tape I have [root@LTOMag ~]# ls -al /dev/tape/by-id/ total 0 drwxr-xr-x 2 root root 100 Jan 9 21:06 ./ drwxr-xr-x 4 root root 80 Jan 9 21:06 ../ lrwxrwxrwx 1 root root 9 Jan 9 21:06 scsi-1QUANTUM_F5C1834008_LLA -> ../../sg3 lrwxrwxrwx 1 root root 9 Jan 9 21:06 scsi-3500308c3ec11e004 -> ../../st0 lrwxrwxrwx 1 root root 10 Jan 9 21:06 scsi-3500308c3ec11e004-nst -> ../../nst0 [root@LTOMag ~]# ls -al /dev/tape/by-path total 0 drwxr-xr-x 2 root root 80 Jan 9 21:06 ./ drwxr-xr-x 4 root root 80 Jan 9 21:06 ../ lrwxrwxrwx 1 root root 9 Jan 9 21:06 pci-:01:00.0-sas-phy3-lun-0 -> ../../st0 lrwxrwxrwx 1 root root 10 Jan 9 21:06 pci-:01:00.0-sas-phy3-lun-0-nst -> ../../nst0 I made a symlink from changer to sg3, without any effect Richard [root@LTOMag ~]# lsscsi -g [0:0:0:0]diskATA WDC WD10EZEX-75W 1A02 /dev/sda /dev/sg0 [1:0:0:0]diskATA WD5003ABYX-23WC38 /dev/sdb /dev/sg1 [6:0:0:0]tapeIBM ULTRIUM-HH8 J4D1 /dev/st0 /dev/sg2 [6:0:0:1]mediumx QUANTUM Scalar i3-i6 160G /dev/sch0 /dev/sg3 On 1/11/19 4:13 PM, Jeffrey R. Lang wrote: In your mtx command output one thing I don't see is the Data Transfer Unit (i.e. tape drive) associated with the tape library. For my tape library I get: [root@bkupsvr3 ~]# mtx -f /dev/xchg0 status Storage Changer /dev/xchg0:4 Drives, 179 Slots ( 2 Import/Export ) Data Transfer Element 0:Full (Storage Element 162 Loaded):VolumeTag = 000162L5 Data Transfer Element 1:Full (Storage Element 120 Loaded):VolumeTag = 000120L5 Data Transfer Element 2:Full (Storage Element 105 Loaded):VolumeTag = 000105L5 Data Transfer Element 3:Full (Storage Element 166 Loaded):VolumeTag = 000166L5 Storage Element 1:Full :VolumeTag=01L5 Storage Element 2:Full :VolumeTag=02L5 Storage Element 3:Full :VolumeTag=03L5 Storage Element 4:Full :VolumeTag=04L5 Storage Element 5:Full :VolumeTag=05L5 Storage Element 6:Full :VolumeTag=06L5 So I wondering does the library either not show drives or is there an issue with the library seeing the tape drive. I would investigate and make sure that the drive and library are connected properly. The output of "lsscsi -g" does who the tape drive? -Original Message- From: Richard Couture Sent: Friday, January 11, 2019 1:59 PM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] mtx and mtx-changer not functioning How odd [root@LTOMag ~]# mt -f /dev/st0 offline [root@LTOMag ~]# mtx -f /dev/sg3 unload 1 0 Data Transfer Element 0 is Empty Now says the tape drive is empty HOWEVER [root@LTOMag ~]# mtx -f /dev/sg3 status Storage Changer /dev/sg3:1 Drives, 30 Slots ( 5 Import/Export ) Data Transfer Element 0:Empty Storage Element 1:Empty:VolumeTag= Storage Element 2:Full :VolumeTag=02L7 Storage Element 3:Full :VolumeTag=03L7 Storage Element 4:Full :VolumeTag=04L7 Storage Element 5:Full :VolumeTag=05L7 Storage Element 6:Full :VolumeTag=06L7 Storage Element 7:Full :VolumeTag=07L7 Storage Element 8:Full :VolumeTag=08L7 Storage Element 9:Full :VolumeTag=09L7 Storage Element 10:Full :VolumeTag=10L7 Storage Element 11:Full :VolumeTag=11L7 Storage Element 12:Full :VolumeTag=12L7 Storage Element 13:Full :VolumeTag=13L7 Storage Element 14:Full :VolumeTag=14L7 Storage Element 15:Full :VolumeTag=15L7 Storage Element 16:Full :VolumeTag=16L7 Storage Element 17:Full :VolumeTag=17L7 Storage Element 18:Full :VolumeTag=18L7 Storage Element 19:Full :VolumeTag=19L7 Storage Element 20:Full :VolumeTag=20L7 Storage Element 21:Full :VolumeTag=21L7 Storage Element 22:Full :VolumeTag=22L7 Storage Element 23:Full :VolumeTag=23L7 Storage Element 24:Full :VolumeTag=24L7 Storage Element 25:Full :VolumeTag=25L7 Storage Element 26 IMPORT/EXPORT:Full :VolumeTag=CLN005CU Storage Element 27 IMPORT/EXPORT:Full :VolumeTag=CLN004CU Storage Element 28 IMPORT/EXPORT:Full :VolumeTag=CLN003CU Storage Element 29 IMPORT/EXPORT:Full :VolumeTag=CLN002CU Storage Element 30 IMPORT/EXPORT:Empty:VolumeTag= syas that the tape was not returned to slot 1 and just for fun [root@LTOMag ~]# mtx -f /dev/sg3 unload Data Transfer Element 0 is Empty [root@LTOMag ~]# mtx -f /dev/sg3 next Loading media from Storage Element 2 into drive 0...mtx: Request Sense: Long Report=yes mtx: Request Sense: Valid Residual=no mtx: Request Sense: Error Code=70 (Current) mtx: Request Sense: Sense Key=Illegal Request mtx: Request Sense: FileM
Re: [Bacula-users] mtx and mtx-changer not functioning
How odd [root@LTOMag ~]# mt -f /dev/st0 offline [root@LTOMag ~]# mtx -f /dev/sg3 unload 1 0 Data Transfer Element 0 is Empty Now says the tape drive is empty HOWEVER [root@LTOMag ~]# mtx -f /dev/sg3 status Storage Changer /dev/sg3:1 Drives, 30 Slots ( 5 Import/Export ) Data Transfer Element 0:Empty Storage Element 1:Empty:VolumeTag= Storage Element 2:Full :VolumeTag=02L7 Storage Element 3:Full :VolumeTag=03L7 Storage Element 4:Full :VolumeTag=04L7 Storage Element 5:Full :VolumeTag=05L7 Storage Element 6:Full :VolumeTag=06L7 Storage Element 7:Full :VolumeTag=07L7 Storage Element 8:Full :VolumeTag=08L7 Storage Element 9:Full :VolumeTag=09L7 Storage Element 10:Full :VolumeTag=10L7 Storage Element 11:Full :VolumeTag=11L7 Storage Element 12:Full :VolumeTag=12L7 Storage Element 13:Full :VolumeTag=13L7 Storage Element 14:Full :VolumeTag=14L7 Storage Element 15:Full :VolumeTag=15L7 Storage Element 16:Full :VolumeTag=16L7 Storage Element 17:Full :VolumeTag=17L7 Storage Element 18:Full :VolumeTag=18L7 Storage Element 19:Full :VolumeTag=19L7 Storage Element 20:Full :VolumeTag=20L7 Storage Element 21:Full :VolumeTag=21L7 Storage Element 22:Full :VolumeTag=22L7 Storage Element 23:Full :VolumeTag=23L7 Storage Element 24:Full :VolumeTag=24L7 Storage Element 25:Full :VolumeTag=25L7 Storage Element 26 IMPORT/EXPORT:Full :VolumeTag=CLN005CU Storage Element 27 IMPORT/EXPORT:Full :VolumeTag=CLN004CU Storage Element 28 IMPORT/EXPORT:Full :VolumeTag=CLN003CU Storage Element 29 IMPORT/EXPORT:Full :VolumeTag=CLN002CU Storage Element 30 IMPORT/EXPORT:Empty:VolumeTag= syas that the tape was not returned to slot 1 and just for fun [root@LTOMag ~]# mtx -f /dev/sg3 unload Data Transfer Element 0 is Empty [root@LTOMag ~]# mtx -f /dev/sg3 next Loading media from Storage Element 2 into drive 0...mtx: Request Sense: Long Report=yes mtx: Request Sense: Valid Residual=no mtx: Request Sense: Error Code=70 (Current) mtx: Request Sense: Sense Key=Illegal Request mtx: Request Sense: FileMark=no mtx: Request Sense: EOM=no mtx: Request Sense: ILI=no mtx: Request Sense: Additional Sense Code = 21 mtx: Request Sense: Additional Sense Qualifier = 01 mtx: Request Sense: Field in Error = 07 mtx: Request Sense: BPV=yes mtx: Request Sense: Error in CDB=yes mtx: Request Sense: SKSV=yes mtx: Request Sense: Field Pointer = 00 02 MOVE MEDIUM from Element Address 4097 to 256 Failed And physically checking; No tape in Slot 1, it remains in the drive Richard On 1/11/19 1:01 PM, Jeffrey R. Lang wrote: I have run into tape libraries that require the tape to be unloaded from the drive before performing an unload command. The mtx-changer script supports this feature. You need to change the .../etc/mtx-changer.conf file, specifically the line # Set to 1 if you want to do offline before unload offline=0 In the example from below mtx -f /dev/sg3 load 1 0 mtx -f /dev/sg3 unload 1 0 add a command to unload the tape from the drive between the two lines mt -f offline -Original Message- From: Sebastian Suchanek Sent: Friday, January 11, 2019 12:53 PM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] mtx and mtx-changer not functioning ◆ This message was sent from a non-UWYO address. Please exercise caution when clicking links or opening attachments from external sources. Am 11.01.2019 um 14:49 schrieb Richard Couture: Does mtx work when you explicitly specify the slots? I.e.: mtx -f /dev/sg3 load 1 0 mtx -f /dev/sg3 unload 1 0 No Then, in my opinion, the problem is somewhere outside of Bacula. My best guess is that either your library and your version of mtx are incompatible or your library is broken (e.g. faulty firmware). Best regards Sebastian ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por
Re: [Bacula-users] How to LTO-8
I found another person with the very same symptoms and they resolved the problem by changing out the SAS host adapter I Note that both my bacula-dir and my bacula-sd conf files have a Storage section, with a Device section only in bacula-sd. Is this correct or should the Storage and Device be in one or the other confs? If they or one or the other sections should be in both confs, should they be identical??? Richard On 1/10/19 6:50 PM, Adam Nielsen wrote: As mentioned earlier, the command ./mtx-changer /dev/sg3 load 1 /dev/st0 0 actually put the desired tape into the drive, however ./mtx-changer /dev/sg3 unload 1 /dev/st0 0 returns the following error message This to me looks like the mtx-changer script is not able to talk to your autochanger properly. I had to modify the script to work with my autochanger, and this is appears to be by design (the mtx-changer script supplied is a default that you are meant to customise for your hardware) so I guess modifying this script is the next step. If the script was present and working with your old Bacula set up, that might be a good place to start looking to see what has changed. ̣root@LTOMag scripts]# ./mtx-changer /dev/sg3 unload 1 /dev/st0 0 Unloading drive 0 into Storage Element 1... mtx: Request Sense: Sense Key=Illegal Request MOVE MEDIUM from Element Address 256 to 4096 Failed I don't know much about low level autochanger commands, but it seems odd that telling the autochanger to put the tape in slot 1 results in a command asking it to put the tape in "element 4096", which the autochanger says is an illegal request. Maybe that's normal but it seems a bit weird. I would start by modifying mtx-changer to output the commands it's trying to run, and then running those commands manually, tweaking them until you figure out how they are supposed to work, and then applying those changes back to mtx-changer. This is assuming nobody else has posted a working mtx-changer script for your autochanger already of course! I split my bacula-dir into components so here are the relevant ones Everything else here looks like it should be fine. Once you get mtx-changer working properly I think everything else should be fine. Cheers, Adam. -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por escrito de LinuxCabal está prohibida. Si usted no es el destinatario a quien se dirige el presente correo, favor de contactar al remitente respondiendo al presente correo y eliminar el correo original incluyendo sus archivos, así como cualesquiera copia del mismo. Mediante la recepción del presente correo usted reconoce y acepta que en caso de incumplimiento de su parte y/o de sus representantes a los términos antes mencionados, LinuxCabal tendrá derecho a los daños y perjuicios que esto le cause. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] mtx and mtx-changer not functioning
No Richard On 1/10/19 11:08 PM, Sebastian Suchanek wrote: Am 11.01.2019 um 02:05 schrieb Richard Couture: [...] [root@LTOMag scripts]# mtx -f /dev/sg3 unload Unloading drive 0 into Storage Element 1...mtx: Request Sense: Long Report=yes mtx: Request Sense: Valid Residual=no mtx: Request Sense: Error Code=70 (Current) mtx: Request Sense: Sense Key=Illegal Request mtx: Request Sense: FileMark=no mtx: Request Sense: EOM=no mtx: Request Sense: ILI=no mtx: Request Sense: Additional Sense Code = 53 mtx: Request Sense: Additional Sense Qualifier = 01 mtx: Request Sense: Field in Error = 00 mtx: Request Sense: BPV=no mtx: Request Sense: Error in CDB=no mtx: Request Sense: SKSV=yes mtx: Request Sense: Field Pointer = 00 00 MOVE MEDIUM from Element Address 256 to 4096 Failed [root@LTOMag scripts]# [...] Does mtx work when you explicitly specify the slots? I.e.: mtx -f /dev/sg3 load 1 0 mtx -f /dev/sg3 unload 1 0 Best regards Sebastian ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por escrito de LinuxCabal está prohibida. Si usted no es el destinatario a quien se dirige el presente correo, favor de contactar al remitente respondiendo al presente correo y eliminar el correo original incluyendo sus archivos, así como cualesquiera copia del mismo. Mediante la recepción del presente correo usted reconoce y acepta que en caso de incumplimiento de su parte y/o de sus representantes a los términos antes mencionados, LinuxCabal tendrá derecho a los daños y perjuicios que esto le cause. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] mtx and mtx-changer not functioning
oc/scsi/scsi Attached devices: Host: scsi0 Channel: 00 Id: 00 Lun: 00 Vendor: ATA Model: WDC WD10EZEX-75W Rev: 1A02 Type: Direct-AccessANSI SCSI revision: 05 Host: scsi1 Channel: 00 Id: 00 Lun: 00 Vendor: ATA Model: WD5003ABYX-23Rev: WC38 Type: Direct-AccessANSI SCSI revision: 05 Host: scsi6 Channel: 00 Id: 00 Lun: 00 Vendor: IBM Model: ULTRIUM-HH8 Rev: J4D1 Type: Sequential-AccessANSI SCSI revision: 06 Host: scsi6 Channel: 00 Id: 00 Lun: 01 Vendor: QUANTUM Model: Scalar i3-i6 Rev: 160G Type: Medium Changer ANSI SCSI revision: 03 [root@LTOMag scripts]# cat /proc/scsi/sg/devices 0 0 0 0 0 1 31 0 1 1 0 0 0 0 1 31 0 1 6 0 0 0 1 1 254 0 1 6 0 0 1 8 1 254 0 1 Anyone know what's going on.??? Richard -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por escrito de LinuxCabal está prohibida. Si usted no es el destinatario a quien se dirige el presente correo, favor de contactar al remitente respondiendo al presente correo y eliminar el correo original incluyendo sus archivos, así como cualesquiera copia del mismo. Mediante la recepción del presente correo usted reconoce y acepta que en caso de incumplimiento de su parte y/o de sus representantes a los términos antes mencionados, LinuxCabal tendrá derecho a los daños y perjuicios que esto le cause. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to LTO-8
" Schedule = "BacchusActiveCycle" Storage = Autochanger Messages = Standard Priority = 10 Pool = Default Write Bootstrap = "/var/lib/bacula/%c.bsr" } JobDefs { Name = "ConfigsHistJob" Type = Backup Level = Full Client = hermes-fd FileSet = "HERMESHistSet" Schedule = "ConfigsHistCycle" Storage = Autochanger Messages = Standard Priority = 10 Pool = Default Write Bootstrap = "/var/lib/bacula/%c.bsr" } and here is conf.d/storage.conf [root@LTOMag conf.d]# cat storage.conf Storage { Name = Autochanger Address = ltomag.asaambiental.mx SDPort = 9103 Password = "" Device = ltomag-drive Media Type = LTO-7 Autochanger = yes } The other included mods are -rw-r- 1 root root 662 Jan 7 12:33 clients.conf -rw-r- 1 root root 27567 Jan 7 12:33 filesets.conf -rw-r- 1 root root 1505 Jan 10 06:30 jobs.conf -rw-r- 1 root root 2241 Jan 7 12:33 pools.conf -rw-r- 1 root root 473 Jan 7 12:33 schedules.conf and finally here is my bacula-sd.conf [root@LTOMag conf.d]# cat ../bacula-sd.conf Storage { Name = ltomag-sd SDPort = 9103 WorkingDirectory = "/var/lib/bacula" Pid Directory = "/var/run/bacula-sd" Maximum Concurrent Jobs = 20 SDAddress = ltomag.asaambiental.mx } Director { Name = ltomag-dir Password = "ltomagsdpass" } Director { Name = ltomag-mon Password = "ltomagmonpass" Monitor = yes } Autochanger { Name = Autochanger Device = ltomag-drive Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d" Changer Device = /dev/sg3 } Device { Name = ltomag-drive Device Type = Tape Media Type = LTO-7 Archive Device = /dev/nst0 AutomaticMount = yes; AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; Maximum File Size = 100GB AutoChanger = yes Alert Command = "sh -c 'smartctl -H -l error %c'" Spool Directory = /var/spool/bacula LabelMedia = yes } Messages { Name = Standard director = ltomag-dir = all } Thanks Richard On 1/9/19 10:34 PM, Adam Nielsen wrote: Automatically selected Storage: LTO-6 This seems to suggest that the Director is configured to use a device called "LTO-6". Care to post the bacula-dir.conf? I know you said there's no mention of "LTO-6" here, but perhaps you need to mention the storage device specifically? With your config names, my bacula-dir.conf would say this: JobDefs { Name = "DefaultJob" Type = Backup Storage = Autochanger ... This would tell Bacula to try to write to "Autochanger" rather than "LTO-6". Connecting to Storage daemon LTO-6 at ltomag.asaambiental.mx:9103 ... 3999 Device "LTO-6" not found or could not be opened. This would make sense because your Storage device is called "LTO-8" so it can't find one called "LTO-6". In my opinion I'd rename your device to use something other than "LTO-8" otherwise you can't tell whether it's referring to the device or the media format: Autochanger { Device = ltomag-drive ... } Device { Name = ltomag-drive Drive Index = 0 Media Type = LTO-7 ... Here, you will know "ltomag-drive" means the Device section, while "LTO-*" means a media type. How can I get bacula to acknowledge the LTO-8 drive with the LTO-7 tapes??? This should all be automatic. In my own setup I'm using an LTO-5 autochanger with LTO-4 tapes, and it works fine. I don't think Bacula actually checks the LTO media, I suspect it just uses the "Media Type" you've specified in the "Device" config. In my above example I wrote "LTO-7", but think this just marks any media that passes through the drive as LTO-7, regardless of what it actually is. I don't think this will cause any problems unless you actually have a single Bacula setup that uses multiple tape types at the same time, and it needs to look at the Media Type in order to decide which drive to load the tape into. Cheers, Adam. -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por escrito de LinuxCabal está prohibida. Si us
[Bacula-users] How to LTO-8
Greetings I am upgrading from Bacula 5 to Bacula 7.4.3, since that is what Mageia 6.1 provides, and from an IBM autoloader with LTO-4 to a Quantum scalar I3 with LTO-8 tape drive using BRAND NEW LTO-7 tapes, and after all is said and done, bacula tells me, when going to label a tape from bconsole, [root@LTOMag ~]# bconsole Connecting to Director ltomag.asaambiental.mx:9101 1000 OK: 102 ltomag-dir Version: 7.4.3 (18 June 2016) Enter a period to cancel a command. *label Automatically selected Catalog: MyCatalog Using Catalog "MyCatalog" Automatically selected Storage: LTO-6 Connecting to Storage daemon LTO-6 at ltomag.asaambiental.mx:9103 ... 3999 Device "LTO-6" not found or could not be opened. Enter autochanger drive[0]: when in fact I have a Quantum scalar i3 with LTO-8 drive using brand new LTO-7 tapes and NOT LTO-6 Also the MySQL MediaType table says MariaDB [bacula]> select * from MediaType; +-+---+--+ | MediaTypeId | MediaType | ReadOnly | +-+---+--+ | 1 | LTO-6 |0 | +-+---+--+ 1 row in set (0.00 sec) I Blew the bacula DB away and assured that NONE of the bacula config files in the /etc/bacula tree had any mention of LTO-6 anywhere before recreating the DB using the /usr/libexec/bacula/make_mysql_tables command and low and behold, again MariaDB [bacula]> select * from MediaType; +-+---+--+ | MediaTypeId | MediaType | ReadOnly | +-+---+--+ | 1 | LTO-6 |0 | +-+---+--+ 1 row in set (0.00 sec) Here is my bacula-sd.conf [root@LTOMag bacula]# cat bacula-sd.conf Storage { Name = ltomag-sd SDPort = 9103 WorkingDirectory = "/var/lib/bacula" Pid Directory = "/var/run/bacula-sd" Maximum Concurrent Jobs = 20 SDAddress = ltomag.asaambiental.mx } Director { Name = ltomag-dir Password = "" } Director { Name = ltomag-mon Password = "X" Monitor = yes } Autochanger { Name = Autochanger Device = LTO-8 Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d" Changer Device = /dev/sg3 } Device { Name = LTO-8 Device Type = Tape Media Type = LTO-8 Archive Device = /dev/nst0 AutomaticMount = yes; AlwaysOpen = yes; RemovableMedia = yes; RandomAccess = no; Maximum File Size = 100GB AutoChanger = yes Alert Command = "sh -c 'smartctl -H -l error %c'" Spool Directory = /var/spool/bacula LabelMedia = yes } Messages { Name = Standard director = ltomag-dir = all } The following rpms are installed [root@LTOMag bacula]# rpm -qa | grep bacula lib64bacula7-7.4.3-3.mga6 bacula-fd-7.4.3-3.mga6 bacula-common-7.4.3-3.mga6 bacula-backup-mysql-0.6.2-10.mga6 bacula-console-7.4.3-3.mga6 lib64bacula-sql7-7.4.3-3.mga6 bacula-sd-7.4.3-3.mga6 bacula-dir-7.4.3-3.mga6 ./mtx-changer /dev/sg3 load 1 /dev/st0 0 works fine How can I get bacula to acknowledge the LTO-8 drive with the LTO-7 tapes??? Thanks Richard -- LinuxCabal Asociación Civil Ing. Richard Couture Novell CNE, ECNE, MCNE HP/Compaq ASE Tel.: (+52) (333) 145-2638 Cel.: (+52) (044) 333 377-7505 Web: http://www.LinuxCabal.org E-Mail: r...@linuxcabal.org Hosted en la nube Cloud Sigma - www.CloudSigma.com AVISO DE CONFIDENCIALIDAD: Este correo electrónico, incluyendo en su caso, los archivos adjuntos al mismo, pueden contener información de carácter confidencial y/o privilegiada, y se envían a la atención única y exclusivamente de la persona y/o entidad a quien va dirigido. La copia, revisión, uso, revelación y/o distribución de dicha información confidencial sin la autorización por escrito de LinuxCabal está prohibida. Si usted no es el destinatario a quien se dirige el presente correo, favor de contactar al remitente respondiendo al presente correo y eliminar el correo original incluyendo sus archivos, así como cualesquiera copia del mismo. Mediante la recepción del presente correo usted reconoce y acepta que en caso de incumplimiento de su parte y/o de sus representantes a los términos antes mencionados, LinuxCabal tendrá derecho a los daños y perjuicios que esto le cause. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Labeling LTO-7 (6 GB) tapes as LTO-M8 (9 GB)?
On Mon, 26 Mar 2018 16:08:31 +0200 Andreas Koch <k...@esa.informatik.tu-darmstadt.de> wrote: > Does anyone know how to label uninitialized LTO-7 (6 GB native) tapes > under Linux as LTO-M8 (9 GB native) for use in an LTO-8 drive? > > Many thanks, > Andreas Koch > Hello Andreas, This document seems to suggest that they can be formatted only in tape libraries and not in standalone drives. However, I'm not sure if that applies only to HP drives/libraries. <https://h20195.www2.hpe.com/V2/getpdf.aspx/A00039948ENW.pdf?> Question: Can I initialize Type M media in a standalone drive? Answer: No, HPE does not initialize Type M media in standalone drives. LTO-7 Type M cartridges must be initialized in a library that supports LTO-7 Type M. The library makes the decision on the type of cartridge based upon the cartridge bar code – if the last two characters are “M8” it will be initialized as Type M, otherwise it will be initialized as a normal LTO-7 cartridge Regards, Richard -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Progress Status Detailed view
> Date: Wednesday, February 21, 2018 22:41:35 +0100 > From: Maurizio Caloro> > Hello > Please exist any possibilities to view the progress from running > backup job at this time i have only the option "Status" "Director" > > here i see that the Job are running, but i don't see how long this > will run and how meny this are backuped in the mean time. > > running with Bacula 5.x > > Regards > M The bacula command "status client" will display a list of your configured clients. You can then select the number for the one you are interested in (e.g., the currently running one) and enter that for more detail. You can also do this as a one-line command if you know the client's name. The detail will show the number of files backed up, storage used, etc. I don't believe that bacula estimates the time left, but that's not that hard to estimate if you've run jobs against that same client previously. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula LTO-5
Hi, On Fri, Jun 02, 2017 at 01:24:46PM +0200, Kern Sibbald wrote: > I don't seem to have the original post of Richard Fox, so could you please > specify what "this directive" is in the sentence: > > Otherwise, this advice is a little contradictory to the documentation which > states "On most modern tape drives, you will not need to specify this > directive. My apologies, I had sent the message from the wrong address and cancelled moderation on it. I was hoping nobody would notice. My original message asked if this discussion was in regard to the "Maximum block size" (and presumably "Minimum block size") from the device resource. "Are you both referring to "Maximum block size" (and presumably "Minimum block size") from the Device resource? If not please ignore the rest of this message. Otherwise, this advice is a little contradictory to the documentation which states "On most modern tape drives, you will not need to specify this directive.". More importantly however, the documentation (for Bacula 7.2 anyways) says: "The maximum size-in-bytes possible is 2,000,000." which contradicts the assertion that these can be specified as 2MB which is not the same thing. Is the documentation inaccurate on this subject?" > On 06/01/2017 02:51 PM, Cejka Rudolf wrote: > > Richard Fox wrote (2017/06/01): > > > Otherwise, this advice is a little contradictory to the documentation > > > which states "On most modern tape drives, you will not need to specify > > > this directive.". > > Given that Linux with LTO-X tape drive is probably a majority system here > > (not counting > > configurations without tape drives), the statement is slightly misleading. > > I'm convinced > > that it is really not needed because of tape drive, server nor HBA, but it > > seems that it > > is really needed because of Linux. However it is not a real problem, > > because Linux allows > > to increase the block size "naturally", with the exception that you have > > limiting HBA. > > > > > More importantly however, the documentation (for Bacula 7.2 anyways) > > > says: "The maximum size-in-bytes possible is 2,000,000." which > > > contradicts the assertion that these can be specified as 2MB which is not > > > the same thing. Is the documentation inaccurate on this subject? > > I wrote 2 MB as a general recommendation over various manufacturers and > > software > > developers, with non-written suggested value 256 KB or 512 KB as max., so > > please > > take my 2 MB limit just loosely :o) Thanks, Rich. -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory r...@mbl.edu - m...@richfox.org 508-289-7669 -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't run bacula any more.
> Date: Thursday, March 16, 2017 13:04:24 +0100 > From: "Erik P. Olsen" <epod...@gmail.com> > > On 2017-03-16 at 11:10:10 Richard wrote: > >> > Date: Thursday, March 16, 2017 08:00:26 +0100 >> > From: "Erik P. Olsen" <epod...@gmail.com> >> > >> > On 2017-03-15 at 21:17:07 Dan Langille wrote: >> > >> >> > On Mar 14, 2017, at 2:42 AM, Erik P. Olsen <epod...@gmail.com> >> >> > wrote: >> >> > >> >> > On 2017-03-13 at 22:52:04 Richard wrote: >> >> > >> >> >> What you have for privileges is what I would expect. My >> >> >> "grant_mysql_privileges" script has two lines - the first >> >> >> will do the "localhost" setup for the bacula user. Assuming >> >> >> that your script is lacking that, you might want to add it >> >> >> and try rerunning the script. >> >> >> >> >> >> grant all privileges on ${db_name}.* to ${db_user}@localhost >> >> >> ${pass}; grant all privileges on ${db_name}.* to >> >> >> ${db_user}@"%" ${pass}; >> >> > >> >> > >> >> > In my script the lines are: >> >> > >> >> > use mysql >> >> > grant all privileges on ${db_name}.* to ${db_user}@localhost >> >> > ${pass} ${ssl_options}; grant all privileges on ${db_name}.* >> >> > to ${db_user}@"%" ${pass} ${ssl_options}; select * from user; >> >> > flush privileges; >> >> > >> >> > Ups, I now see that a semicolon is missing after "use mysql". >> >> > I'll add it and rerun the script: >> >> > Oh it won't let me do the "use mysql;" Access denied. >> >> >> >> >> >> Perhaps connect to mysql using the user name / password you have >> >> in the Catalog definition. >> > >> > [erik@Erik-PC ~]$ mysql bacula --user=bacula >> > ERROR 1044 (42000): Access denied for user ''@'localhost' to >> > database 'bacula' >> > >> > I am afraid it will never work :-( >> >> > From the output you provided, the "grant" script that you are >> > running >> doesn't appear to be giving access permissions to bacula@localhost >> - though seems to be for bacula@%. You might just want to look at >> the bacula@% records and (manually) enter matching ones for >> bacula@localhost. I suspect that that will at least get you on to >> the next step. > > MariaDB [(none)]> grant all privileges on bacula.* to > bacula@localhost; ERROR 1044 (42000): Access denied for user > ''@'localhost' to database 'bacula' > > Apparently gets me nowhere. > You need to be mysql/mariadb or system root to do that (or at least identified as a user with "grant" privileges). Also, you don't appear to have a database selected, hence the '[(none)]' on the prompt. Note, the initial tables that you need to effect are mysql.user and mysql.db. Look at the records for the bacula@% entries for templates of what is needed. I would probably [mysql]dump the records from the various mysql db tables, change the '%' to 'localhost' on the bacula user ones, remove the other records (and create statements, if you included them) and then load the resulting ones in. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't run bacula any more.
> Date: Thursday, March 16, 2017 08:00:26 +0100 > From: "Erik P. Olsen" <epod...@gmail.com> > > On 2017-03-15 at 21:17:07 Dan Langille wrote: > >> > On Mar 14, 2017, at 2:42 AM, Erik P. Olsen <epod...@gmail.com> >> > wrote: >> > >> > On 2017-03-13 at 22:52:04 Richard wrote: >> > >> >> What you have for privileges is what I would expect. My >> >> "grant_mysql_privileges" script has two lines - the first will >> >> do the "localhost" setup for the bacula user. Assuming that >> >> your script is lacking that, you might want to add it and try >> >> rerunning the script. >> >> >> >> grant all privileges on ${db_name}.* to ${db_user}@localhost >> >> ${pass}; grant all privileges on ${db_name}.* to ${db_user}@"%" >> >> ${pass}; >> > >> > >> > In my script the lines are: >> > >> > use mysql >> > grant all privileges on ${db_name}.* to ${db_user}@localhost >> > ${pass} ${ssl_options}; grant all privileges on ${db_name}.* to >> > ${db_user}@"%" ${pass} ${ssl_options}; select * from user; >> > flush privileges; >> > >> > Ups, I now see that a semicolon is missing after "use mysql". >> > I'll add it and rerun the script: >> > Oh it won't let me do the "use mysql;" Access denied. >> >> >> Perhaps connect to mysql using the user name / password you have >> in the Catalog definition. > > [erik@Erik-PC ~]$ mysql bacula --user=bacula > ERROR 1044 (42000): Access denied for user ''@'localhost' to > database 'bacula' [erik@Erik-PC ~]$ > > I am afraid it will never work :-( >From the output you provided, the "grant" script that you are running doesn't appear to be giving access permissions to bacula@localhost - though seems to be for bacula@%. You might just want to look at the bacula@% records and (manually) enter matching ones for bacula@localhost. I suspect that that will at least get you on to the next step. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't run bacula any more.
> Date: Monday, March 13, 2017 23:30:36 +0100 > From: "Erik P. Olsen" <epod...@gmail.com> > > On 2017-03-13 at 16:07:35 Richard wrote: > >> > Date: Monday, March 13, 2017 15:34:04 +0100 >> > From: "Erik P. Olsen" <epod...@gmail.com> >> > >> > On 2017-03-13 at 13:38:44 Richard wrote: >> > >> >> >> >> When you ran the "grant_mysql_privileges" script did it give a >> >> multi-column display of settings, with something like >> >> "Privileges for user ..." at the bottom? If so, could you >> >> confirm the user/db information on that line (you can rerun the >> >> script without having to take any other actions). If not, what >> >> type of output (if any) did you get? >> > >> > These are the first few lines: >> > >> > [root@Erik-PC bacula]# ./grant_mysql_privileges >> > Created MySQL database user: bacula >> > ERROR 1133 (28000) at line 2: Can't find any matching row in the >> > user table HostUserPasswordSelect_priv >> > Insert_privUpdate_priv Delete_priv >> > Create_privDrop_priv Reload_priv Shutdown_priv >> > >> > And this is the last: >> > >> > Privileges for user bacula granted on database bacula. >> >> To see if that last line is accurate or not (and whether that error >> is spurious), as root (either system or mysql), at the "MariaDB >> [(none)]>" prompt: >> >>use mysql; >>select * from user where User='bacula' \G >> >> [note, end that command with an uppercase "\G", that will display >> the output in a list, rather than a table.] > > > MariaDB [(none)]> use mysql; > Reading table information for completion of table and column names > You can turn off this feature to get a quicker startup with -A > > Database changed > MariaDB [mysql]> select * from user where User='bacula' \G > *** 1. row *** > Host: % > User: bacula > Password: . . . >> >> and: >> >>select * from db where User='bacula' \G > > MariaDB [mysql]> select * from db where User='bacula' \G > *** 1. row *** > Host: % >Db: bacula > User: bacula . . . > > >> >> The first should show two records - both for User "bacula", but one >> for Host "%" and one for "localhost" -- with (most) everything set >> to "N". >> >> The second should also show two records, same Host and User values >> and Db "bacula", but with everything (except the "Grant" privilege) >> set to "Y". > > There doesn't seem to be one for "localhost". What you have for privileges is what I would expect. My "grant_mysql_privileges" script has two lines - the first will do the "localhost" setup for the bacula user. Assuming that your script is lacking that, you might want to add it and try rerunning the script. grant all privileges on ${db_name}.* to ${db_user}@localhost ${pass}; grant all privileges on ${db_name}.* to ${db_user}@"%" ${pass}; -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't run bacula any more.
Original Message > Date: Monday, March 13, 2017 15:34:04 +0100 > From: "Erik P. Olsen" <epod...@gmail.com> > > On 2017-03-13 at 13:38:44 Richard wrote: > >> > Date: Monday, March 13, 2017 14:07:04 +0100 >> > From: "Erik P. Olsen" <epod...@gmail.com> >> > >> > On 2017-03-13 at 12:40:52 Richard wrote: >> > >> >> If it shows a list of the ~25+ tables (likely ending with >> >> "Version"), then exit mysql/mariadb and (still as system root) >> >> run the "grant_mysql_privileges" script that's in your >> >> /usr/libexec/bacula/ directory. >> > >> > Yes, I see 26 rows ending with Version. >> > >> >> >> >> After doing that, then as a normal (non-root) system user, do: >> >> >> >>mysql -u bacula >> >> >> >>[i don't believe that a password is set, but you can look at >> >>thetop of the grant script to confirm this.] >> >> >> >>show databases; >> > >> > Unfortunately does not show "bacula". >> > >> >> >> When you ran the "grant_mysql_privileges" script did it give a >> multi-column display of settings, with something like "Privileges >> for user ..." at the bottom? If so, could you confirm the user/db >> information on that line (you can rerun the script without having >> to take any other actions). If not, what type of output (if any) >> did you get? > > These are the first few lines: > > [root@Erik-PC bacula]# ./grant_mysql_privileges > Created MySQL database user: bacula > ERROR 1133 (28000) at line 2: Can't find any matching row in the > user table Host UserPasswordSelect_priv > Insert_priv Update_priv Delete_priv > Create_priv Drop_priv Reload_priv Shutdown_priv > > And this is the last: > > Privileges for user bacula granted on database bacula. To see if that last line is accurate or not (and whether that error is spurious), as root (either system or mysql), at the "MariaDB [(none)]>" prompt: use mysql; select * from user where User='bacula' \G [note, end that command with an uppercase "\G", that will display the output in a list, rather than a table.] and: select * from db where User='bacula' \G The first should show two records - both for User "bacula", but one for Host "%" and one for "localhost" -- with (most) everything set to "N". The second should also show two records, same Host and User values and Db "bacula", but with everything (except the "Grant" privilege) set to "Y". -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't run bacula any more.
> Date: Monday, March 13, 2017 14:07:04 +0100 > From: "Erik P. Olsen" <epod...@gmail.com> > > On 2017-03-13 at 12:40:52 Richard wrote: > ... >> >> If it shows a list of the ~25+ tables (likely ending with >> "Version"), then exit mysql/mariadb and (still as system root) run >> the "grant_mysql_privileges" script that's in your >> /usr/libexec/bacula/ directory. > > Yes, I see 26 rows ending with Version. > >> >> After doing that, then as a normal (non-root) system user, do: >> >>mysql -u bacula >> >>[i don't believe that a password is set, but you can look at >>thetop of the grant script to confirm this.] >> >>show databases; > > Unfortunately does not show "bacula". > When you ran the "grant_mysql_privileges" script did it give a multi-column display of settings, with something like "Privileges for user ..." at the bottom? If so, could you confirm the user/db information on that line (you can rerun the script without having to take any other actions). If not, what type of output (if any) did you get? -- Announcing the Oxford Dictionaries API! The API offers world-renowned dictionary content that is easy and intuitive to access. Sign up for an account today to start using our lexical data to power your apps and projects. Get started today and enter our developer competition. http://sdm.link/oxford ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't run bacula any more.
> Date: Monday, March 13, 2017 12:26:07 +0100 > From: "Erik P. Olsen" <epod...@gmail.com> > > On 2017-03-13 at 09:15:17 Richard wrote: > >> > Date: Monday, March 13, 2017 07:40:08 +0100 >> > From: "Erik P. Olsen" <epod...@gmail.com> >> > >> > On 2017-03-12 at 18:58:55 Mike Ruskai wrote: >> > >> >> On 3/12/2017 10:29, Erik P. Olsen wrote: >> >> > >> >> > [snip] >> >> > >> >> > mysql -u bacula >> >> > >> >> > was OK. >> >> > >> >> > show databases; >> >> > >> >> > gave: >> >> > >> >> > ++ >> >> > | Database | >> >> > ++ >> >> > | information_schema | >> >> > | test | >> >> > ++ >> >> > >> >> > So apparently the scripts did not create the bacula database. >> >> > I'll have to see why that happened. >> >> > >> >> >> Is your root DB password blank as well? Were you logged in as >> >> root when running the scripts? >> > Root DB password: don't know. I was using su - when running the >> > scripts. >> >> >> >> What do you get if you simply type "mysql" on the command line? >> >> If you get a prompt, what does "show processlist" report? >> > >> > >> > [root@Erik-PC etc]# exit >> > log ud >> > [erik@Erik-PC ~]$ mysql >> > Welcome to the MariaDB monitor. Commands end with ; or \g. >> > Your MariaDB connection id is 722 >> > Server version: 10.1.21-MariaDB MariaDB Server >> > >> > Copyright (c) 2000, 2016, Oracle, MariaDB Corporation Ab and >> > others. >> > >> > Type 'help;' or '\h' for help. Type '\c' to clear the current >> > input statement. >> > >> > MariaDB [(none)]> >> > >> >> >> >> If you weren't logged in as root when running the script, with a >> >> blank root DB password, then the DB scripts wouldn't work. >> >> >> >> That is, with a secured DB server, this wouldn't work: >> >> >> >> /usr/libexec/bacula/create_bacula_database >> >> >> >> But this would, provided the password were correct: >> >> >> >> /usr/libexec/bacula/create_bacula_database -u root >> >> --password= >> >> >> >> The scripts don't just fail silently, either. >> >> A slight follow-on. You should invoke mysql as mysql root (mysql -u >> root -p [if the password isn't set pressing a CR will get you past >> the password prompt]) or after su-ing to system root (and then >> don't use the "-u root -p"). Once you have the "mysql>" prompt >> issue the "show databases;" command. The output should include the >> "mysql" database. If the "bacula" database is also listed that >> indicates that it was set up but not permitted to the mysql >> "bacula" user. If it's not there (but you see the "mysql" >> database) that's an indication that your bacula database creation >> effort(s) failed. > > With root I got: > > ++ >| Database | > ++ >| bacula | >| information_schema | >| mysql | >| performance_schema | >| test | > ++ Now, as system root: mysql bacula and once at the "MariaDB [bacula]>" prompt: show tables; If it shows a list of the ~25+ tables (likely ending with "Version"), then exit mysql/mariadb and (still as system root) run the "grant_mysql_privileges" script that's in your /usr/libexec/bacula/ directory. After doing that, then as a normal (non-root) system user, do: mysql -u bacula [i don't believe that a password is set, but you can look at the top of the grant script to confirm this.] show databases; If it now shows the "bacula" database: use bacula; show tables; Ideally you'll see the same list of ~25 tables. If that works, that should indicate that the obvious bacula table creation/privileges issue(s) have been resolved, so you should try to proceed with bacula (where this all started) and see what you get. You may want to double check the "Catalog" section of your bacula-dir.conf file (in /etc/bacula) to confirm that the db credentials line shows: dbname = "bacula"; dbuser = "bacula"; dbpassword = "" -- Announcing the Oxford Dictionaries API! The API offers world-renowned dictionary content that is easy and intuitive to access. Sign up for an account today to start using our lexical data to power your apps and projects. Get started today and enter our developer competition. http://sdm.link/oxford ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't run bacula any more.
> Date: Monday, March 13, 2017 07:40:08 +0100 > From: "Erik P. Olsen"> > On 2017-03-12 at 18:58:55 Mike Ruskai wrote: > >> On 3/12/2017 10:29, Erik P. Olsen wrote: >> > >> > [snip] >> > >> > mysql -u bacula >> > >> > was OK. >> > >> > show databases; >> > >> > gave: >> > >> > ++ >> > | Database | >> > ++ >> > | information_schema | >> > | test | >> > ++ >> > >> > So apparently the scripts did not create the bacula database. >> > I'll have to see why that happened. >> > >> Is your root DB password blank as well? Were you logged in as root >> when running the scripts? > Root DB password: don't know. I was using su - when running the > scripts. >> >> What do you get if you simply type "mysql" on the command line? If >> you get a prompt, what does "show processlist" report? > > > [root@Erik-PC etc]# exit > log ud > [erik@Erik-PC ~]$ mysql > Welcome to the MariaDB monitor. Commands end with ; or \g. > Your MariaDB connection id is 722 > Server version: 10.1.21-MariaDB MariaDB Server > > Copyright (c) 2000, 2016, Oracle, MariaDB Corporation Ab and others. > > Type 'help;' or '\h' for help. Type '\c' to clear the current input > statement. > > MariaDB [(none)]> > >> >> If you weren't logged in as root when running the script, with a >> blank root DB password, then the DB scripts wouldn't work. >> >> That is, with a secured DB server, this wouldn't work: >> >> /usr/libexec/bacula/create_bacula_database >> >> But this would, provided the password were correct: >> >> /usr/libexec/bacula/create_bacula_database -u root >> --password= >> >> The scripts don't just fail silently, either. A slight follow-on. You should invoke mysql as mysql root (mysql -u root -p [if the password isn't set pressing a CR will get you past the password prompt]) or after su-ing to system root (and then don't use the "-u root -p"). Once you have the "mysql>" prompt issue the "show databases;" command. The output should include the "mysql" database. If the "bacula" database is also listed that indicates that it was set up but not permitted to the mysql "bacula" user. If it's not there (but you see the "mysql" database) that's an indication that your bacula database creation effort(s) failed. -- Announcing the Oxford Dictionaries API! The API offers world-renowned dictionary content that is easy and intuitive to access. Sign up for an account today to start using our lexical data to power your apps and projects. Get started today and enter our developer competition. http://sdm.link/oxford ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't run bacula any more.
> Date: Sunday, March 12, 2017 17:33:40 +0100 > From: "Erik P. Olsen"> To: Sven Hartge > > On 2017-03-12 at 15:31:35 Sven Hartge wrote: > >> First step should be to fix the database so that the director >> daemon starts correctly and _then_ see if this automagically fixes >> the problem with bconsole (I think it will). > > Yes. The big thing is how to fix it. I have reinstall mariadb, > dropped the database and reran the scripts from /usr/libexec/bacula > to no avail. Last efford will be to remove mariadb and install > mysqld instead. > I don't believe that this is a mysql/mariadb issue as they are basically interchangeable. Rather, it appears that one or more of the scripts for setting up the bacula db and tables for isn't getting run [successfully]. Could you provide a list of the files in your /usr/libexec/bacula/ directory? [please reply only to the list. do not include my direct address.] -- Announcing the Oxford Dictionaries API! The API offers world-renowned dictionary content that is easy and intuitive to access. Sign up for an account today to start using our lexical data to power your apps and projects. Get started today and enter our developer competition. http://sdm.link/oxford ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't run bacula any more.
> Date: Sunday, March 12, 2017 11:53:57 +0100 > From: "Erik P. Olsen"> To: Kern Sibbald > > Hello Kern, > > I've read the manual numerous times and followed the instructions > again and again. > > mysql mysql >> select * from user; > > works OK, so I assume everything is OK with the database and the > access privileges. There seems nothing I can do other than continue > taking backups from my old desktop which for other reasons is not > advisable. > Looking back through all the messages in this thread, it appears that you have two problems. One is that you can't connect to the director daemon: bconsole: bsock.c:278-0 Could not connect to server Director daemon 192.168.1.36:9101. ERR=Connection refused You likely need to fix the configuration in your bacula bconsole.conf file. The other is your db setup/access: Error 1044 (42000): Access denied for user ''@'localhost' to database 'bacula' bacula-dir: dird.c:969-0 Could not open Catalog "MyCatalog", database "bacula" The sequence that you have tried: > mysql mysql >> select * from user; doesn't tell you much of anything related to bacula. The "mysql" db and "user" table are part of the mysql basic setup so will always be there if you have mysql/mariadb installed and configured. What you need to test for bacula is the existence of the db "bacula" and (access to the) tables within that. Start with the command: mysql -h -u bacula [if you have changed the defaults in the "Catalog" section of your bacula-dir.conf you will need to make the necessary adjustments to the above.] from the machine where you have the bacula-sd installed. If they are all on the same (new) machine, then the "-h " part is unnecessary. This should get you the mysql herald and "mysql>" prompt. Assuming it does, issue the command: show databases; that should give you a list that includes "bacula". Assuming so, then: use bacula; and: show tables; Assuming no errors, the last command should give you a list of 20+ tables. Try issuing a: select * from ; for any of them [e.g., "Client" or "Job"). Given that you haven't done any backups yet they should be empty, but being able to read a table goes somewhat to the access issue. You should also try inserting a (minimal) record into one of the tables to see if you have write access. You'll want to delete it if successful. If any of this fails, try: use mysql; select * from user where User="bacula"; and let us know what gets returned. Based on the results we can suggest further actions. -- Announcing the Oxford Dictionaries API! The API offers world-renowned dictionary content that is easy and intuitive to access. Sign up for an account today to start using our lexical data to power your apps and projects. Get started today and enter our developer competition. http://sdm.link/oxford ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't run bacula any more.
> Date: Monday, March 06, 2017 13:13:38 +0100 > From: "Erik P. Olsen"> > This is my catalogue definition: > ># ># Generic catalog service ># > Catalog { > Name = MyCatalog > dbname = "bacula"; dbuser = "bacula"; dbpassword = "" > } > > I don't think there is any dbpassword. I tried to copy as much as > possible from my old machine which does not use dbpassword and my > tests for mysql connect seems to indicate that dbpassword is not > needed. There are scripts for setting up the mysql tables and permissions for bacula. I believe that these are generally found in the /etc/bacula/setup directory. Did you run these, or do the setup manually (or none of the above)? -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Git repo down?
> Date: Monday, January 02, 2017 11:03:11 + > From: Michael Munger> > All: > > Seems the git repo is down? > > git clone http://git.bacula.org/bacula gives the following error: > > Fatal: repository 'http://git.bacula.org/bacula' not found. > > This started after Kern (I think) did an update to the website. >From a message from Kern the other day, the repo name changed slightly. I was able to reach it, under the new repo name, a few minutes ago. >> Date: Tuesday, December 27, 2016 16:22:41 +0100 >> From: Kern Sibbald >> However, please note one thing. The name of the repo >> is bacula.git, so your clone statement should be: >> >> git clone http://git.bacula.org/bacula.git -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director will not connect to a remote client
> Date: Monday, March 14, 2016 15:27:47 -0700 > From: maaf4d> > I am using the public IP address of the machines like so: > > Storage { # definition of myself > Name = storage-sd > SDPort = 9103 # Director's port > WorkingDirectory = "/var/lib/bacula" > Pid Directory = "/var/run/bacula" > Maximum Concurrent Jobs = 20 > SDAddress = public.ip.address.xx > } > You should double check that you don't have 127.0.0.1 or localhost specified anywhere in your configurations. About the only way you are going to get netstat output like: tcp 0 0 127.0.1.1:9101 0.0.0.0:* LISTEN 6591/bacula-dir tcp 0 0 127.0.1.1:9102 0.0.0.0:* LISTEN 1886/bacula-fd tcp 0 0 127.0.1.1:9103 0.0.0.0:* LISTEN 1865/bacula-sd is if you are specifying the localhost name or ipnumber. Also, that "xxAddress" line is optional and, as the documentation indicates, it should bind to all addresses if nothing is specified. Try dropping that line. [by the way, could you please reply with context. it is very hard to reply to your messages from the mailing list side when they don't carry any of the thread.] -- Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785231=/4140 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director will not connect to a remote client
> Date: Monday, March 14, 2016 17:00:51 -0500 > From: Dimitri Maziuk> > On 03/14/2016 04:45 PM, maaf4d wrote: >> How would I change that? Maybe that is my issue > > Sorry. I played with OpenStack a year or so ago and decided it > wasn't worth my time. So I've no idea, all I can tell you is 127/8 > is the loopback address as defined in RFC1122 and will not be > routed outside localhost. Are you specifying an IPnumber on the "address" directives? E.g., SDAddresses = { ip = { addr = 127.0.0.1; port = 9103; } } If so, and you're using "127.0.0.1", then it will only listen in the internal interface, not the external, which is what your netstat is showing. I believe that there are options for this for all the daemons. from the current documentation: SDAddress = This directive is optional, and if it is specified, it will cause the Storage daemon server (for Director and File daemon connections) to bind to the specified IP-Address, which is either a domain name or an IP address specified as a dotted quadruple. If this directive is not specified, the Storage daemon will bind to any available address (the default). -- Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785231=/4140 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director will not connect to a remote client
> Date: Sunday, March 13, 2016 11:41:40 -0700 > From: maaf4d> > Ok so there seems to be some kind of issue with the public IP > addresses of OpenStack to where I can't really use the IP addresses > to connect to the nodes even tough I can ssh to them. It's very > weird. > > Anyway, I tried to install Bacula on some of the machines on my > lab. I made one machine the server, and another one a client. I > opened the ports and made sure that they're listening on the right > ports. Although, I cannot get the machines to connect. When I use > telnet, I get a connection refused message. I can ping the machines > just fine. > A "connection refused" response to a telnet generally means that the target machine isn't listening on the port you tried. Use netstat to make certain that the daemon is listening on the external interface for the port(s) you are trying. If you reach a listening daemon, but there are access control issues, you'll likely get a different response. -- Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785111=/4140 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director will not connect to a remote client
> Date: Thursday, March 10, 2016 09:05:43 -0800 > From: maaf4d> > IPTables on Server: > > Chain OUTPUT (policy ACCEPT) > target prot opt source destination > ACCEPT tcp -- anywhere anywhere state NEW tcp dpts:bacula-dir:bacula-sd > > Client's IPTables rules: > > Chain OUTPUT (policy ACCEPT) > target prot opt source destination > ACCEPT tcp -- anywhere anywhere state NEW tcp dpt:bacula-fd I think that your iptables output policies are a part of your problem. A machine's output policy constrains what ports the source side can go out from. With bacula you are going *to* ports 9101-03, but *from* an arbitrary (high numbered) port. So, while you may want to constrain that ports you accept inbound (input) connections on, you generally leave the outbound (output) totally open. In your case, you appear to be constraining your outbound ports to 9101 and 03 on your server and 9102 on the client. That, in fact, means that you very likely aren't getting out at all. Remove those outbound constraints from iptables and things should improve. I think you still have other issues, but you should be able to telnet to the 9101-03 ports (as appropriate) and get at least a "connection refused" response from the remote host. -- Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785111=/4140 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director will not connect to a remote client
> Date: Wednesday, March 09, 2016 16:56:14 -0800 > From: maaf4d> > Ana, > > I did change the IP address in bconsole and I still can't connect > to it. I believe the previous reply to Wanderlei answers the other > question. I also tried the command you suggested for testing the > connection and it is not connection. When you try to telnet from the backup server to port 9102 on the client machine what type of response do you get? If you get a network "hang", then the issue is most likely a firewall. If the machine is on the same network segment the firewall is probably on the target machine. If the machine is on a different network segment the firewall could be at any router between the two machines (but I'd start with the target machine). If you reach the machine but it's not listening on 9102 you'll probably get a "connection refused" response. You might also get a connection that opens and then immediately closes, or some other permutation, which generally indicates some type of configuration or access issue on the target machine. By the way, if the passwords you have been including in your configuration outputs are the real ones, you should change them on the machines in question, and be certain to not include them in your posts ongoing. -- Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785111=/4140 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula and NFS
But I am able to access the share outside of Bacula with ease, so the NFS share is mounted. On Sat, Dec 12, 2015 at 6:25 AM, Kern Sibbald <k...@sibbald.com> wrote: > Run the SD with debug level set to about 200. I suspect that the NFS > share is not mounted, so when the SD attempts to open it, it is blocked by > the OS, which is what happens when you try to access an NSF volume that is > not mounted. > > Best regards, > Kern > > On 04.12.2015 15:19, Richard Robbins wrote: > > I am new to Bacula and would like to run the Bacula director on a CentOS 7 > virtual machine with the FQDN of bacula.itinker.net and use a NAS device > as my storage repository. For now, my NAS is a somewhat dated Netgear > ReadyNAS device that I'm going to replace with a new Synology box in the > not-too-distant future. > > I've got Version 7.0.5 of the Bacula components runnning on the Centos > machine and can backup and restore to a local directory without > difficulty. I'm struggling to get the NAS into the mix. > > In my all local configuration I backup to /bacula/backup and restore to > /bacula/restore. > > I had hoped that I could tweak the system so that I mount an NFS v3 share > at /bacula/backup. > > The OS mounts the NFS share at that point and I'm able to read and write > files without difficulty but when I fire up Bacula the program hangs with > accompanying warning messages "Warning: bsock.c:112 Could not connect to > Storage daemon on bacula.itinker.net:9103. ERR=Connection refused. > > Since I'm able to read and write the NFS share outside of Bacula I'm > stumped as to what's getting the way when Bacula runs. > > In a perfect world I suppose I'd run the director and SD on the NAS > itself, but I'm not up to attempting to build the current Bacula system on > my older NAS. Maybe I should try to compile the storage daemon but not the > director on the NAS and then point the director on my VM to a daemon > running on the NAS. But that too is more work than just mounting the NFS > share as I am doing at the moment. > > Another approach would be to create an iSCSI target and pass that to my VM > as a virtual disc which would just be embedded in the virtual hardware > prior to system boot time, but I'd like to avoid that if possible. > > Your thoughts and guidance will be greatly appreciated. > > -- Rich > > > -- > Go from Idea to Many App Stores Faster with Intel(R) XDK > Give your users amazing mobile app experiences with Intel(R) XDK. > Use one codebase in this all-in-one HTML5 development environment. > Design, debug & build mobile apps & 2D/3D high-impact games for multiple > OSs.http://pubads.g.doubleclick.net/gampad/clk?id=254741911=/4140 > > > > ___ > Bacula-users mailing > listBacula-users@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/bacula-users > > > -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula and NFS
I am new to Bacula and would like to run the Bacula director on a CentOS 7 virtual machine with the FQDN of bacula.itinker.net and use a NAS device as my storage repository. For now, my NAS is a somewhat dated Netgear ReadyNAS device that I'm going to replace with a new Synology box in the not-too-distant future. I've got Version 7.0.5 of the Bacula components runnning on the Centos machine and can backup and restore to a local directory without difficulty. I'm struggling to get the NAS into the mix. In my all local configuration I backup to /bacula/backup and restore to /bacula/restore. I had hoped that I could tweak the system so that I mount an NFS v3 share at /bacula/backup. The OS mounts the NFS share at that point and I'm able to read and write files without difficulty but when I fire up Bacula the program hangs with accompanying warning messages "Warning: bsock.c:112 Could not connect to Storage daemon on bacula.itinker.net:9103. ERR=Connection refused. Since I'm able to read and write the NFS share outside of Bacula I'm stumped as to what's getting the way when Bacula runs. In a perfect world I suppose I'd run the director and SD on the NAS itself, but I'm not up to attempting to build the current Bacula system on my older NAS. Maybe I should try to compile the storage daemon but not the director on the NAS and then point the director on my VM to a daemon running on the NAS. But that too is more work than just mounting the NFS share as I am doing at the moment. Another approach would be to create an iSCSI target and pass that to my VM as a virtual disc which would just be embedded in the virtual hardware prior to system boot time, but I'd like to avoid that if possible. Your thoughts and guidance will be greatly appreciated. -- Rich -- Go from Idea to Many App Stores Faster with Intel(R) XDK Give your users amazing mobile app experiences with Intel(R) XDK. Use one codebase in this all-in-one HTML5 development environment. Design, debug & build mobile apps & 2D/3D high-impact games for multiple OSs. http://pubads.g.doubleclick.net/gampad/clk?id=254741911=/4140___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula and NFS
Thank you Devin. What you say makes great sense. Oddly, as soon as I switched to an iSCSI mount instead of an NFS mount things worked. Perhaps I configured the NFS mount incorrectly, but it worked just fine outside of Bacula. On Fri, Dec 4, 2015 at 6:42 PM, Devin Reade <g...@gno.org> wrote: > --On Friday, December 04, 2015 08:19:00 AM -0600 Richard Robbins > <rerobb...@itinker.net> wrote: > > > The OS mounts the NFS share at that point and I'm able to read and write > > files without difficulty but when I fire up Bacula the program hangs with > > accompanying warning messages "Warning: bsock.c:112 Could not connect to > > Storage daemon on bacula.itinker.net:9103. ERR=Connection refused. > > > > Since I'm able to read and write the NFS share outside of Bacula I'm > > stumped as to what's getting the way when Bacula runs. > > It helps to read the error message in detail. The problem you're having > has nothing to do with NFS; it's a network connectivity issue. Check > the IP and port on which your storage daemon is running, ensure that > ports are opened up in the appropriate firewalls, and if necessary > do some sniffing with tcpdump. > > Chances are your SD firewalld settings are wrong. > > How performant this setup will be once you actually get it working > is another question, as was mentioned in another reply. > > Devin > > > > -- > Go from Idea to Many App Stores Faster with Intel(R) XDK > Give your users amazing mobile app experiences with Intel(R) XDK. > Use one codebase in this all-in-one HTML5 development environment. > Design, debug & build mobile apps & 2D/3D high-impact games for multiple > OSs. > http://pubads.g.doubleclick.net/gampad/clk?id=254741911=/4140 > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- Go from Idea to Many App Stores Faster with Intel(R) XDK Give your users amazing mobile app experiences with Intel(R) XDK. Use one codebase in this all-in-one HTML5 development environment. Design, debug & build mobile apps & 2D/3D high-impact games for multiple OSs. http://pubads.g.doubleclick.net/gampad/clk?id=254741911=/4140___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Support for HAVE_POSIX_FADVISE on Bacula Client
On 10/10/2015 19:30, Kern Sibbald wrote: > On 10/10/2015 10:16 AM, Phil Stracchino wrote: >> On 10/09/15 22:05, Kern Sibbald wrote: >>> Hello, >>> >>> Thanks for pointing this out. I still have problems imagining that they >>> would define O_RDONLY as 0 in a bitmapped variable!!! >> It makes more sense if you think of it as the absence of O_RDWR. > > Unfortunately, it is even more complicated than that, because it is > actually the absence of O_RWRD and O_WRONLY. > > In my opinion the original implementation was faulty because O_RDONLY > should really be defined as: > > #define O_RDONLY !(O_RWRD_RONLY) > > See my second to last commit ... > > Goan, but that is how it is so now we know, and hopefully it should now > work correctly. > > Best regards, > Kern Aren't people over-complicating this? You need to think of this as a 2-bit integer field, not as a bitmap. Then looking at the constants defined in fcntl.h, it becomes clear (to me, anyway!) that the code should be (sorry, I forget the exact context, but you'll see what I mean, I hope) (flags & O_ACCMODE) == O_RDONLY (The Solaris box I am looking at defines #define O_ACCMODE 3 /* Mask for file access modes */ while a nearby Linux system has #define O_ACCMODE 0003 #define O_RDONLY #define O_WRONLY0001 #define O_RDWR 0002 ) Regards, Richard -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unable to send mail with mutt as mailcommand
Original Message Date: Thursday, May 14, 2015 09:11:10 AM -0400 From: Bill Arlofski waa-bac...@revpol.com On 05/14/2015 01:33 AM, Kelvin Minter wrote: Hello I am running bacula 5.2.13 on CentOS 6.6. I have the following configuration for my messages in /etc/bacula/bacula-dir.conf Messages { Name = Standard mailcommand = /usr/bin/mutt -F /root/.muttrc-bacula -s \Bacula: %t %e of %c %l\ %r operatorcommand = /usr/bin/mutt -F /root/.muttrc-bacula -s \Bacula: Intervention needed for %j\ %r mail = myem...@domain.com mailto:myem...@domain.com = all, !skipped operator = myem...@domain.com mailto:myem...@domain.com = mount console = all, !skipped, !saved append = /var/log/bacula/bacula.log = all, !skipped catalog = all } When I run mutt on the command line it proceeds and I am able to receive the mail at my destination address. However, when running a job I receive no email upon completion of the job and no log is created within bacula or maillog. I am using tls for postfix but this should be no issue as I can run the above mailcommand from the command line and receive an email. Using bsmtp (Unable to send because I need to run through tls) will produce an erroneous entry in the maillog file. I am stumped on how to debug further to determine where the mail is being caught up at. It seems to have to be something on bacula's end. Any help would be appreciated. Hi Kelvin, I would first check to see what user that the bacula-dir daemon is running as: # ps axuf | grep bacula-dir On some distributions, the director runs as user bacula, on others (like Gentoo) it runs as user root. The director does not need to run as root, but some distributions package Bacula so that it does. You are pointing mutt to a config file in the root user's home directory, perhaps mutt, running as bacula when called by the director simply can not read the config file and exits? Bill From your slightly obscured configuration, I'm assuming that you're trying to deliver the mail directly from bacula to your remote mail server, not localhost, which is why you have the bsmtp/TLS issue. I believe that if you use the default Bacula bsmtp setup to deliver to localhost and then alias the recipient off (with an entry in /etc/aliases) you should be ok. That approach will invoke the (postfix) MTA -- which will handle TLS just fine. [and avoids the issue of trying to configure a different mailer.] E.g., mailcommand = /usr/sbin/bsmtp -h localhost -f ... mail = user@localhost = all, !skipped operator = user@localhost = mount which is the default Bacula configuration and what I use on my centos box. - Richard -- One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications Performance metrics, stats and reports that give you Actionable Insights Deep dive visibility with transaction tracing using APM Insight. http://ad.doubleclick.net/ddm/clk/290420510;117567292;y ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bacula splitting big jobs in to two
Hi, On Thu, 29 Jan 2015, Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] wrote: I run bacula 5.2.12 on a RHEL server which is attached to a Tape Library. I have two LTO5 tape drives. Since the data on one of my server has grown big the back-up takes 10-12 days to complete. I would like to split this job in to two jobs. Has anybody done this kind of a set-up? I need some guidance on how to go about it. I did something like this with our backups, dividing them up in order to decrease the amount of time necessary for backups. At the time I conceived this system, we had about 56TB of data. For historic reasons our backups were made from NFS exports from a single central NAS fileserver, because it was proprietary, I couldn't directly access the fileserver any other way. (This has changed but I haven't made substantial changes to the procedure yet.) I have two tape libraries for this each with two drives, and both support partitioning. I partitioned the two libraries so that from the computer's perspective I have 4 libraries. Our filesystems are composed primarily of user directories and working group directories. I calculated the size of each of these directories and then used a basic bin-packing algorithm to subdivide them into four groups each being assigned to a parition. A preperation script is used to mount each directory as a separate NFS mount in its respective group directory. The groups were sized such that the ratio of the data to the capacity of a given library's partition were more or less the same for the four groups. I created four pools, four jobs, for storage devices, etc., all to match up with the 4 library paritions and four groups, essentially creating 4 complete backup jobs. When it's time to take new base backups, I repeat the calculation, bin-packing part and run the update the mount points to redistribute the data. It did cut down the time required to do base backups substantially. I was also able to remove a set of files that while only occupied about a terabyte, contained tens of millions of tiny files that massively slowed down the backup process whenever it hit that spot. Perhaps you have similar conditions on your filesystems? Thanks, Rich. -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- Dive into the World of Parallel Programming. The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Restoring Files still an issue
Hello List, I am still at a loss to find out why the restore process is restoring only folders and not files. I have tried as suggested in a previous email to reset permissions on those restored folders without success. Even after changing permissions I still do not see any files being restored even though the output from the Bacula Server says the files have been restored. Any help would be greatly appreciated. Thank you [cid:D96AEEBC-8478-4ED0-AA58-0B0EFF2DDFAC@voip.conwaycorp.net]http://www.facebook.com/AtlanticBusSys[cid:C848E789-712B-4FF3-B334-257C7FC098EB@voip.conwaycorp.net]https://www.linkedin.com/company/534239?trk=prof-0-ovw-curr_pos[cid:E585E237-A942-4C80-8569-FD447522943B@voip.conwaycorp.net]https://twitter.com/ABS4Sharp Richard Durivage IT Support Atlantic Business Systems Office (321) 259-7575 Ext. 241 Cell (321) 506-1913 rduriv...@abs4sharp.commailto:rduriv...@abs4sharp.com [Description: Description: Description: Description: email_sig2][cid:image001.png@01CCEBDE.7A52B710]http://www.nationals.com/ Leveraging Technology to Improve Office Efficiency! -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring Files still an issue
Hello John, When I restore the files to the Linux server it works fine. They get restored to the /etc/bacula/backups folder and with root privileges I am able to see the files. [cid:D96AEEBC-8478-4ED0-AA58-0B0EFF2DDFAC@voip.conwaycorp.net]http://www.facebook.com/AtlanticBusSys[cid:C848E789-712B-4FF3-B334-257C7FC098EB@voip.conwaycorp.net]https://www.linkedin.com/company/534239?trk=prof-0-ovw-curr_pos[cid:E585E237-A942-4C80-8569-FD447522943B@voip.conwaycorp.net]https://twitter.com/ABS4Sharp Richard Durivage IT Support Atlantic Business Systems Office (321) 259-7575 Ext. 241 Cell (321) 506-1913 rduriv...@abs4sharp.commailto:rduriv...@abs4sharp.com [Description: Description: Description: Description: email_sig2][cid:image001.png@01CCEBDE.7A52B710]http://www.nationals.com/ Leveraging Technology to Improve Office Efficiency! From: John Drescher [mailto:dresche...@gmail.com] Sent: Thursday, January 22, 2015 9:16 AM To: Richard Durivage Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Restoring Files still an issue I am still at a loss to find out why the restore process is restoring only folders and not files. I have tried as suggested in a previous email to reset permissions on those restored folders without success. Even after changing permissions I still do not see any files being restored even though the output from the Bacula Server says the files have been restored. Any help would be greatly appreciated. Thank you Try restoring the files to your linux bacula server. John -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring Files still an issue
Hello Edmar, I am using Bacula 5.2.6 through a Virtualmin installation. [cid:image006.jpg@01D03628.72F9CE30] [cid:D96AEEBC-8478-4ED0-AA58-0B0EFF2DDFAC@voip.conwaycorp.net]http://www.facebook.com/AtlanticBusSys[cid:C848E789-712B-4FF3-B334-257C7FC098EB@voip.conwaycorp.net]https://www.linkedin.com/company/534239?trk=prof-0-ovw-curr_pos[cid:E585E237-A942-4C80-8569-FD447522943B@voip.conwaycorp.net]https://twitter.com/ABS4Sharp Richard Durivage IT Support Atlantic Business Systems Office (321) 259-7575 Ext. 241 Cell (321) 506-1913 rduriv...@abs4sharp.commailto:rduriv...@abs4sharp.com [Description: Description: Description: Description: email_sig2][cid:image001.png@01CCEBDE.7A52B710]http://www.nationals.com/ Leveraging Technology to Improve Office Efficiency! From: edmar.meloara...@gmail.com [mailto:edmar.meloara...@gmail.com] On Behalf Of Edmar Araújo Sent: Thursday, January 22, 2015 9:41 AM To: Richard Durivage Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Restoring Files still an issue Hi Richard, Which version of this using Bacula? In the restore process try using markdir directory and then to mark the files If possible make available the log restore the bconsole run joblog list jobid=Number_Job_ID Best regards! 2015-01-22 12:22 GMT-02:00 Richard Durivage rduriv...@abs4sharp.commailto:rduriv...@abs4sharp.com: Hello John, When I restore the files to the Linux server it works fine. They get restored to the /etc/bacula/backups folder and with root privileges I am able to see the files. [cid:D96AEEBC-8478-4ED0-AA58-0B0EFF2DDFAC@voip.conwaycorp.net]http://www.facebook.com/AtlanticBusSys[cid:C848E789-712B-4FF3-B334-257C7FC098EB@voip.conwaycorp.net]https://www.linkedin.com/company/534239?trk=prof-0-ovw-curr_pos[cid:E585E237-A942-4C80-8569-FD447522943B@voip.conwaycorp.net]https://twitter.com/ABS4Sharp Richard Durivage IT Support Atlantic Business Systems Office (321) 259-7575tel:%28321%29%20259-7575 Ext. 241 Cell (321) 506-1913tel:%28321%29%20506-1913 rduriv...@abs4sharp.commailto:rduriv...@abs4sharp.com [Description: Description: Description: Description: email_sig2][cid:image001.png@01CCEBDE.7A52B710]http://www.nationals.com/ Leveraging Technology to Improve Office Efficiency! From: John Drescher [mailto:dresche...@gmail.commailto:dresche...@gmail.com] Sent: Thursday, January 22, 2015 9:16 AM To: Richard Durivage Cc: bacula-users@lists.sourceforge.netmailto:bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Restoring Files still an issue I am still at a loss to find out why the restore process is restoring only folders and not files. I have tried as suggested in a previous email to reset permissions on those restored folders without success. Even after changing permissions I still do not see any files being restored even though the output from the Bacula Server says the files have been restored. Any help would be greatly appreciated. Thank you Try restoring the files to your linux bacula server. John -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet ___ Bacula-users mailing list Bacula-users@lists.sourceforge.netmailto:Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Atenciosamente, Edmar Araújo | Daqui a um minuto é o Futuro. http://3dmar.com -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula Restore Issues
Hello everyone, I am experiencing an issue with Bacula when restoring files from a backup. I am able to restore folders but not files. If I select a certain amount of files and folders to be restored and then initiate the job it completes and says the job was successful but only Folders get created. Files are not re-created. I am trying to restore from Bacula to a Windows Server 2012. Here is the output from the Bacula dashboard. Any help would be greatly appreciated ! Thank you = Starting restore of job ABS-TESTBED to client ABS-TESTBED from storage File .. restore client=ABS-TESTBED jobid=152 storage=File where=C:/Shared Using Catalog MyCatalog You have selected the following JobId: 152 Building directory tree for JobId(s) 152 ... + 578 files inserted into the tree. You are now entering file selection mode where you add (mark) and remove (unmark) files to be restored. No files are initially added, unless you used the all keyword on the command line. Enter done to leave this mode. cwd is: / $ cd C:/Shared cwd is: C:/Shared/ $ mark bacula-win64-5.2.10.exe 1 file marked. $ cd C:/Shared cwd is: C:/Shared/ $ mark Microsoft Toolkit.exe 1 file marked. $ cd C:/Shared cwd is: C:/Shared/ $ mark Win8StartButtonSetup.exe 1 file marked. $ cd C:/Shared cwd is: C:/Shared/ $ mark Setup.x86.en-US_HomeBusinessRetail.exe 1 file marked. $ done Bootstrap records written to /var/lib/bacula/abs-bacula-dir.restore.5.bsr The job will require the following Volume(s) Storage(s)SD Device(s) === TEST File FileStorage Volumes marked with * are online. 4 files selected to be restored. Run Restore job JobName: RestoreFiles Bootstrap: /var/lib/bacula/abs-bacula-dir.restore.5.bsr Where: C:/Shared Replace: always FileSet: Full Set Backup Client: ABS-TESTBED Restore Client: ABS-TESTBED Storage: File When:2015-01-20 09:54:46 Catalog: MyCatalog Priority:10 Plugin Options: *None* OK to run? (yes/mod/no): .. the restore is now running. When complete, the results will be shown below .. 20-Jan 09:54 abs-bacula-dir JobId 234: Start Restore Job RestoreFiles.2015-01-20_09.54.46_25 20-Jan 09:54 abs-bacula-dir JobId 234: Using Device FileStorage 20-Jan 09:54 abs-bacula-sd JobId 234: Ready to read from volume TEST on device FileStorage (/etc/bacula/backups). 20-Jan 09:54 abs-bacula-sd JobId 234: Forward spacing Volume TEST to file:block 5:4045500874. 20-Jan 09:55 abs-bacula-dir JobId 234: Bacula abs-bacula-dir 5.2.6 (21Feb12): Build OS: i686-pc-linux-gnu ubuntu 14.04 JobId: 234 Job:RestoreFiles.2015-01-20_09.54.46_25 Restore Client: ABS-TESTBED Start time: 20-Jan-2015 09:54:48 End time: 20-Jan-2015 09:55:08 Files Expected: 4 Files Restored: 4 Bytes Restored: 46,026,611 Rate: 2301.3 KB/s FD Errors: 0 FD termination status: OK SD termination status: OK Termination:Restore OK .. restore complete. [cid:D96AEEBC-8478-4ED0-AA58-0B0EFF2DDFAC@voip.conwaycorp.net]http://www.facebook.com/AtlanticBusSys[cid:C848E789-712B-4FF3-B334-257C7FC098EB@voip.conwaycorp.net]https://www.linkedin.com/company/534239?trk=prof-0-ovw-curr_pos[cid:E585E237-A942-4C80-8569-FD447522943B@voip.conwaycorp.net]https://twitter.com/ABS4Sharp Richard Durivage IT Support Atlantic Business Systems Office (321) 259-7575 Ext. 241 Cell (321) 506-1913 rduriv...@abs4sharp.commailto:rduriv...@abs4sharp.com [Description: Description: Description: Description: email_sig2][cid:image001.png@01CCEBDE.7A52B710]http://www.nationals.com/ Leveraging Technology to Improve Office Efficiency! -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] general question to robocopy and bacula
Hi, No, it shouldn't fail. I'm backing up a filesystem in which that very situation is happening. It completed fine twice last night while data was still streaming in. Thanks, Rich. On Wed, 17 Dec 2014, Markus Rosjat wrote: Hello List, my simple question is: If I have data that gets copied from a remote location to the bacupserver with robocopy and bacula is running a job on the directory while robocopy is changing it could that cause bacula to fail the job with an r/w error ? regards -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=164703151iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] general question to robocopy and bacula
Hi, I'm sorry, I responded too soon. I'm not in fact, using robocopy (presumably on Windows?). I'm using rsync on Linux. Thanks, Rich. On Wed, 17 Dec 2014, Richard Fox wrote: Hi, No, it shouldn't fail. I'm backing up a filesystem in which that very situation is happening. It completed fine twice last night while data was still streaming in. Thanks, Rich. On Wed, 17 Dec 2014, Markus Rosjat wrote: Hello List, my simple question is: If I have data that gets copied from a remote location to the bacupserver with robocopy and bacula is running a job on the directory while robocopy is changing it could that cause bacula to fail the job with an r/w error ? regards -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=164703151iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Ubuntu 14.04 (was Re: Bacula for OSX 10.9)
Hi, I'm coming late to this thread but... On 07/09/2014 10:42, Kern Sibbald wrote: On 09/07/2014 07:33 AM, Eric Dannewitz wrote: I'm interested in perhaps deploying this in my k-8 school, but I have not found a good tutorial of how to install it. Or if it even works right on Mac. Anyone have some insights on this? My idea would be to back about 30 macs to an Ubuntu server. This would be a good way to setup Bacula. The Director, SD and catalog work well on a Ubuntu server -- I recommend Trusty (14.04). A word of caution - I updated the Ubuntu server that runs my director/mysql from 12.04 to 14.04 a couple of weeks ago using the versions packaged as part of the distribution. When my differential/full backup jobs ran over the past 2 weekends I noticed that they were taking a bit longer than they had been prior to the upgrade. In the case of full backups this past weekend one job that previously took 4 hours now took 28 hours for a system with 1 million files to backup! I initially wondered if an improvement to MySQL had changed the operation of things and maybe the database needed some tuning. I'd also spent very little time optimising my Bacula configuration because it always worked well enough! After a bit of investigation I worked out that the principle problem was batch insertion of attributes into the database. It turns out that Ubuntu ship something approximating to Bacula 5.2.6. That version does not have the optimised version of batch insertion (in blocks of 32 entries) and instead inserts each entry into the batch table singly. Two days ago I did a very rough and ready local build/backport of the relevant changes to src/cats/mysql.c and that seems to have brought the backup times down to sensible levels. For reference the relevant change is http://www.bacula.org/git/cgit.cgi/bacula/commit/?id=a06b88f9c66cd697bc067807c4da14f232675d08 I haven't reported this in either Ubuntu (or Debian) bugtrackers yet but I believe that a similar thing will also affect the other database backends because they don't have the batch optimisations in 5.2.6 either. I suspect that the real solution would be to package the latest 5.2.13 (or even 7.x series) for Ubuntu but it is something to be aware of if you plan on using the native packages. Side note: I'm not sure why the performance went down between 12.04 and 14.04 because I kept the same bacula/mysql configuration between the two. I can only assume that it was something related to disk persistence where 14.04 was actually waiting for the information to be properly on the disk before letting an SQL transaction commit. Regards Richard For the Mac's someone probably has made the binaries and distributes them on the Internet. Otherwise if you load all the appropriate build tools on the Mac, you can easily build the FD. Later this year, Bacula Systems will provide free binaries for MacOSX which should also help. If you have the budget, I *strongly* recommend taking the Bacula Systems Admin I training. It will provide you with everything you need to know and if you ask in advance, they can probably help you with the Mac builds. Best regards, Kern Thanks! Sent from my iSomething -- -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Want excitement? Manually upgrade your production database. When you want reliability, choose Perforce Perforce version control. Predictably reliable. http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Stop unfinished backup, retain data
Hi All, I use Bacula 5.2.6. If I'm not mistaken when I have a backup running and I cancel it, Bacula discards the backup records for the data it has taken to tape which requires Bacula to back up the same files again on the next run. Isn't that correct? If that is correct, is there any way to stop a running backup in which Bacula retains what it has managed to backup so far and picks up where it left off on the next run? Thanks, Rich. -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] ibdata1
Hi, On Fri, 25 Jul 2014, Ken Mandelberg wrote: My ibdata1 file is currently at almost a GB. As far as I know Bacula is the only thing using mysql on my workstation. Is this size normal? I think it can be perfectly normal. As far as I understand it, unless you're using file-per-table option in MySQL (or MariaDB) then these files will contain all of the data that is stored using InnoDB table format. http://dev.mysql.com/doc/refman/5.6/en/glossary.html#glos_ibdata_file I have made the mistake of omitting the file-per-table option when I wanted to use it and recall having to dump the tables, re-initialize the system, then import the data. I think my ibdata files were up to about 16G when I noticed the problem. I've seen generic mysql postings about ibdata1 expanding because of bad transactions and the inability to shrink it. I'm not sure how this fits in with Bacula. I'm sorry, I can't comment on this part except I understand that you can't reclaim the disk space used by these files except for anything but innodb data. That is, when you free up space by truncating or dropping innodb tables, it frees up space within these files but only MySQL can use it for new innodb data. It doesn't change their size on disk. Bacula can store a lot of data depending on what you're using it on. My Bacula database (using file-per-table as measured by du -sh ...) is at 42G. Thanks, Rich. -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- Want fast and easy access to all the code in your enterprise? Index and search up to 200,000 lines of code with a free copy of Black Duck Code Sight - the same software that powers the world's largest code search on Ohloh, the Black Duck Open Hub! Try it now. http://p.sf.net/sfu/bds ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] rpm repo for CentOS 6 anyone?
Hi Jari all, On Thu, 8 May 2014, Jari Fredriksson wrote: CentOS 6 has bacula 5.0.0 which has a bug so that it prunes jobs older than 43 years, no matter how it was defined for director. I could not find a repo or rpm for full Bacula package (only for client), but hopefully someone else knows? I don't know about a repo. I use CentOS 6.4, 6.5 and have compiled Bacula 5.2.x for it from source. I recall that it builds with no issues. I haven't migrated to 7 yet but based on my experience with 5 I doubt there would be any problems. I'd be happy to provide any additional details if you like, email me directly. Thanks, Rich. -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- Is your legacy SCM system holding you back? Join Perforce May 7 to find out: #149; 3 signs your SCM is hindering your productivity #149; Requirements for releasing software faster #149; Expert tips and advice for migrating your SCM now http://p.sf.net/sfu/perforce ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Thanks From Me Too!
Hi, I also would like to thank Kern Sibbald all of the other people involved in the Bacula project and John Drescher for suggesting it to me probably a long time ago. I was previously using commercial backup software and was forbidden by the vendor to adapt it to the changing architecture of our systems even though it was possible to do so (albeit by sacrificing functionality that I wouldn't be able to use anyway). Switching to Bacula solved those problems and gave me more functionality than ever before. It has been liberating for me and the people that depend on my work (even though they don't know it). Thanks, Rich. -- Rich Fox Systems Administrator JBPC - Marine Biological Laboratory http://www.mbl.edu/jbpc 508-289-7669 - mbl-at-richfox.org -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] restoring a directory recursively as of a specific date
Hi Ken, On 03/02/2014 00:16, Ken Mandelberg wrote: None of the restore options do what I think would be a common need, ie to restore a directory recursively as it existed on a certain date. Am I missing something? This can be done pretty easily using restore. However to get an accurate copy that takes account of deleted files you need to have Accurate enabled on your backup jobs. http://www.bacula.org/en/dev-manual/main/main/Released_Version_3_0_3_3_0_.html#SECTION00421000 Then from bconsole use restore. option 6 Select backup for a client before a specified time enter the date that you want to recover and the client/fileset. Once that is selected bacula drops you into file selection mode. From file selection mode you can navigate the file hierarchy using cd and use the mark command to mark directories/files recursively. e.g. cd /var mark www would mark all of /var/www for restoration. See http://www.bacula.org/en/dev-manual/main/main/Restore_Command.html Hope this helps. Best Regards Richard -- Managing the Performance of Cloud-Based Applications Take advantage of what the Cloud has to offer - Avoid Common Pitfalls. Read the Whitepaper. http://pubads.g.doubleclick.net/gampad/clk?id=121051231iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] plugin
Hi, I am new to the list. Just want to understand the difference between enterprise and community versions. Besides the commercial support which is very important to medium and large companies, enterprise version has some interesting plugins, e.g. bandwidth throttling, VSS, NDMP, block level backup. Are these available to community version after some time? Or they have to be purchased? If have to be purchased, do they come with source code or just binary? I am interested in running some plugins on embedded linux appliance so source code is important. Thanks, Richard -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] FreeBSD - libbaccats-5.2.6.so not found after upgrading
On 02/03/2012 16:52, Doug Sampson wrote: Hello- While upgrading from 5.2.3 to 5.2.6 on a FreeBSD 9.0-RELEASE machine and restarting, I encountered an error as follows: === Done displaying pkg-message files === Upgrade of bacula-client-5.2.3 to bacula-client-5.2.6 complete root@pisces:/# rehash root@pisces:/# /usr/local/etc/rc.d/z-bacula.sh restart Stopping the Bacula File daemon Stopping the Bacula Storage daemon Stopping the Bacula Director daemon Starting the Bacula Storage daemon Starting the Bacula File daemon Starting the Bacula Director daemon Shared object libbaccats-5.2.6.so not found, required by bacula-dir root@pisces:/# find / | g libbaccats /usr/local/lib/libbaccats.so.5 /usr/local/lib/libbaccats-postgresql.so /usr/local/lib/libbaccats-postgresql.la /usr/local/lib/libbaccats.so /usr/local/lib/libbaccats.la /usr/local/lib/libbaccats-postgresql.so.5 root@pisces:/# Should I create a libbaccats-5.2.6.so symlink to libbaccats.so? ~Doug Hi Doug, Did you update both bacula-client *and* bacula-server? When you update the client it removes all of the shared libraries that belong to that version, ie. 5.2.3 in your case, including those used by the server binaries. Regards, Richard -- Virtualization Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] FreeBSD - libbaccats-5.2.6.so not found after upgrading
On 02/03/2012 20:32, Doug Sampson wrote: On 02/03/2012 16:52, Doug Sampson wrote: Hello- While upgrading from 5.2.3 to 5.2.6 on a FreeBSD 9.0-RELEASE machine and restarting, I encountered an error as follows: === Done displaying pkg-message files === Upgrade of bacula-client-5.2.3 to bacula-client-5.2.6 complete root@pisces:/# rehash root@pisces:/# /usr/local/etc/rc.d/z-bacula.sh restart Stopping the Bacula File daemon Stopping the Bacula Storage daemon Stopping the Bacula Director daemon Starting the Bacula Storage daemon Starting the Bacula File daemon Starting the Bacula Director daemon Shared object libbaccats-5.2.6.so not found, required by bacula-dir root@pisces:/# find / | g libbaccats /usr/local/lib/libbaccats.so.5 /usr/local/lib/libbaccats-postgresql.so /usr/local/lib/libbaccats-postgresql.la /usr/local/lib/libbaccats.so /usr/local/lib/libbaccats.la /usr/local/lib/libbaccats-postgresql.so.5 root@pisces:/# Should I create a libbaccats-5.2.6.so symlink to libbaccats.so? ~Doug Hi Doug, Did you update both bacula-client *and* bacula-server? When you update the client it removes all of the shared libraries that belong to that version, ie. 5.2.3 in your case, including those used by the server binaries. Yes, I upgraded the server first before upgrading the client. I then restarted the services and, lo and behold, the error message. Should I reinstall the client? ~Doug It wouldn't hurt to try... Regards, Richard -- Virtualization Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] FD feature requests
Item 1: Read-only mode for file daemon Origin: Richard Tector rich...@tector.org.uk Date: 12th Feb 2012 Status: What: The ability to configure the file daemon to operate in a read-only mode, ie. refuse to run restore jobs. This would ideally be set in the daemon's configuration file, either as a list of 'allowed' job types (Backup/Verify) as a simple read-only knob. Why:In the event of the server running the Bacula Director service being compromised, having distributed file daemons in a read-only mode would stop critical files from being overwritten remotely and so leading to additional system compromises. In the event of a file restore being required, the read-only knob could be flipped locally on a temporary basis. Notes: Whilst the file daemon does have a '-k' option, this is not reliably cross-platform. Additionally it is not always feasible to reduce the privileges of the bacula user and then use file system ACLs to limit write privileges. This feature request obviously does not remove the risk from the file daemon being compromised. Item 2: File daemon directory restrictions Origin: Richard Tector rich...@tector.org.uk Date: 12th Feb 2012 Status: What: The ability within the file daemon configuration to restrict which directories can be accessed by a remote Director for backup/restore jobs, etc. Why:A system may have sensitive data on it that does not require backing up with Bacula. These files/directories may be backed up either to a different Director/File daemon or through another method. The ability to set restrictions would reduce the risk of data leakage in the event that the Director is compromised. Notes: As with the former feature request, it is not always feasible or desired to restrict access through the use of file system access controls. Again, this feature would not mitigate against file daemon compromise. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Updating from debian package 5.0.2 to current version
Hi all, I'm wondering which steps I actually have to do to upgrade from the default debian repository bacula to the current version. I did download the current version and compiled (make / make install) the files. What are the next steps? Are there any database upgrades necessary? Cheers, Richard -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] how to multiplex two jobs using two different tape pools
All my backup jobs spool to disk before going to tape. I have a small set of jobs that can take several days to complete and it locks up the use of the tape drive. I would like to have the drive freed while the long job is spooling to disk so that the smaller jobs can run. I realize that there will be some amount of extra tape changing between pools. I have successfully run multiple jobs together when they use the same pool, but when I try to specify different pools I get the waiting to reserve a device message on the job. I am running an older version of bacula - 2.0.3. Am planning on upgrading soon to a later version. If this was Files, I know that I could create a second Device, but the documentation indicates that this should not be done with tapes. Thanks. Richard -- RSA(R) Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup Folders using Wild and RegExDir
On Tue, 2 Aug 2011 15:25:12 +0200, Richard Marnau said: Martin, thanks for the follow up. I did change the configuration without success. Do you might have any other idea? Is my understanding of the lines correct? FileSet { Name = ClientWindows Include { File = C:/Dokumente und Einstellungen - INCLUDE ALL OTHER SUBFOLDERS Options { signature = MD5 compression = GZIP IgnoreCase = yes WildDir = C:/Dokumente und Einstellungen/*/Desktop --- INCLUDE DESKTOP FROM EVERY USER WildDir = C:/Dokumente und Einstellungen/*/Eigene Dateien -- INCLUDE EIGENE DATEIEN FROM EVERY USER #Alle Benutzerverzeichnise mit einbeziehen. RegExDir=^C:/Dokumente und Einstellungen/[^/]+$ --- - Copy Past from the manuell - no idea #Alle Benutzer Desktop Verzeichnise und Unterverzeichnise Wild = C:/Dokumente und Einstellungen/*/Desktop/* - - INCLUDE ALL FILES FROM DESKTOP #Alle Benutzer Eigene Dateien und Unterverzeichnise Wild = C:/Dokumente und Einstellungen/*/Eigene Dateien/* -- --- INCLUDE ALL FILES FROM EIGENE DATEIEN } Options { Exclude = yes IgnoreCase = yes Wild= C:/Dokumente und Einstellungen/* -- --- EXCLUDE EVERYTHING ELSE } } } That looks correct to me. Did you reload the configuration in the director? Did it back up anything at all? E.g. use estimate job=... listing level=full. Which version of Windows is the client using? __Martin Thanks Martin again, I did miss to change the level to full after changing the fileset. Cheers :-) -- BlackBerryreg; DevCon Americas, Oct. 18-20, San Francisco, CA The must-attend event for mobile developers. Connect with experts. Get tools for creating Super Apps. See the latest technologies. Sessions, hands-on labs, demos much more. Register early save! http://p.sf.net/sfu/rim-blackberry-1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup Folders using Wild and RegExDir
On Mon, 25 Jul 2011 17:37:24 +0200, Richard Marnau said: Hi all, I'm trying to backup Desktop and Documents from all users on a client. Bacula manual is a good point to start / Page 172 does have an example to backup only pictures folders from Windows Clients. Unfortunaly all backups and settings I tried did not include any of the files or folders (or to much of them). Directorys to backup: C:/Dokumente und Einstellungen/*/Desktop/* C:/Dokumente und Einstellungen/*/Eigene Dateien/* -- My FileSet: FileSet { Name = ClientWindows Include { File = C:/Dokumente und Einstellungen Options { signature = MD5 compression = GZIP IgnoreCase = yes #Alle Benutzerverzeichnise mit einbeziehen. RegExDir=^C:/Dokumente und Einstellungen/[^/]+$ #Alle Benutzer Desktop Verzeichnise und Unterverzeichnise Wild = C:/Dokumente und Einstellungen/*/Desktop/* #Alle Benutzer Eigene Dateien und Unterverzeichnise Wild = C:/Dokumente und Einstellungen/*/Eigene Dateien/* } Options { Exclude = yes IgnoreCase = yes Wild= C:/Dokumente und Einstellungen/* } } } Where is my mistake and why ? I think you need to add the Desktop and Eigene Dateien directories themselves. I.e. add this to the first options clause like in the manual: WildDir = C:/Dokumente und Einstellungen/*/Desktop WildDir = C:/Dokumente und Einstellungen/*/Eigene Dateien __Martin Martin, thanks for the follow up. I did change the configuration without success. Do you might have any other idea? Is my understanding of the lines correct? FileSet { Name = ClientWindows Include { File = C:/Dokumente und Einstellungen - INCLUDE ALL OTHER SUBFOLDERS Options { signature = MD5 compression = GZIP IgnoreCase = yes WildDir = C:/Dokumente und Einstellungen/*/Desktop --- INCLUDE DESKTOP FROM EVERY USER WildDir = C:/Dokumente und Einstellungen/*/Eigene Dateien -- INCLUDE EIGENE DATEIEN FROM EVERY USER #Alle Benutzerverzeichnise mit einbeziehen. RegExDir=^C:/Dokumente und Einstellungen/[^/]+$ Copy Past from the manuell - no idea #Alle Benutzer Desktop Verzeichnise und Unterverzeichnise Wild = C:/Dokumente und Einstellungen/*/Desktop/* -- INCLUDE ALL FILES FROM DESKTOP #Alle Benutzer Eigene Dateien und Unterverzeichnise Wild = C:/Dokumente und Einstellungen/*/Eigene Dateien/* - INCLUDE ALL FILES FROM EIGENE DATEIEN } Options { Exclude = yes IgnoreCase = yes Wild= C:/Dokumente und Einstellungen/* - EXCLUDE EVERYTHING ELSE } } } Cheers, Richard -- BlackBerryreg; DevCon Americas, Oct. 18-20, San Francisco, CA The must-attend event for mobile developers. Connect with experts. Get tools for creating Super Apps. See the latest technologies. Sessions, hands-on labs, demos much more. Register early save! http://p.sf.net/sfu/rim-blackberry-1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Resetting/truncating table File?
Hi all, our Bacula director (Bacula v3) has a corrupt File table. We tried repairing it but to no avail. Backups do exist, but we were wondering if there is a safe way to simply truncate the File table, throwing all legacy information away. I am aware that this would mean a full backup instead of incremental so this is, in part, a theoretical question more than anything else. Still: Is there a way to cleanly wipe the File table? If we decide to wipe it after all, we would obviously read in the current set of backups once again to make sure only incremental backups would be made, not full ones of everything. THanks, Richard -- BlackBerryreg; DevCon Americas, Oct. 18-20, San Francisco, CA The must-attend event for mobile developers. Connect with experts. Get tools for creating Super Apps. See the latest technologies. Sessions, hands-on labs, demos much more. Register early save! http://p.sf.net/sfu/rim-blackberry-1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bscan back volumes
Hi all, i'm trying to bscan back a volume, but the results are always the same: The file index is not restored L. What do I miss or how can I check if there has been any file index restored? SCAN: === bscan -s -m -c bacula-sd.conf -P -v -V Y-mond-fd-2011-05-Vol /mnt/backupserver Results: == bscan: bscan.c:637 End of all Volumes. VolFiles=1 VolBlocks=0 VolBytes=5,328,646,644 Records added or updated in the catalog: 1 Media 1 Pool 1 Job 72468 File Trying to restore: = Select FileSet resource (1-2): 2 +---+---+--+---+-++ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName | +---+---+--+---+-++ | 2,934 | F | 72,467 | 5,309,805,623 | 2011-05-18 16:47:35 | Yearly-mond-fd-2011-05 | +---+---+--+---+-++ You have selected the following JobId: 2934 Building directory tree for JobId(s) 2934 ... For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. Thanks, Richard -- Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bscan back volumes
Hi all, i’m trying to bscan back a volume, but the results are always the same: The file index is not restored ☹. What do I miss or how can I check if there has been any file index restored? SCAN: === bscan -s -m -c bacula-sd.conf -P -v -V Y-mond-fd-2011-05-Vol /mnt/backupserver Results: == bscan: bscan.c:637 End of all Volumes. VolFiles=1 VolBlocks=0 VolBytes=5,328,646,644 Records added or updated in the catalog: 1 Media 1 Pool 1 Job 72468 File The output is actually quite interesting. He is trying to build the index and suddenly stops. That's what i don't get .. -- Select FileSet resource (1-2): 2 +---+---+--+---+-+---+ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName | +---+---+--+---+-+---+ | 3,003 | F | 72,468 | 5,324,390,746 | 2011-05-24 08:27:02 | Y-mond-fd-2011-05-Vol | +---+---+--+---+-+---+ You have selected the following JobId: 3003 Building directory tree for JobId(s) 3003 ... For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. --- Thanks a lot in advanced for all hints .. Cheers Richard -- Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bscan back volumes
I did create a new database and did the same bscan, this one was working. Job/volume/pool is set to 365 days in the pool configuration. Just wondering: If the client file retention is still default and the pools file retention is set, Which one will actually be in action? I guess the shorter one (client default 60 days?) -Ursprüngliche Nachricht- Von: Ken Barclay [mailto:ken.barc...@qbmore.com] Gesendet: Donnerstag, 28. Juli 2011 10:47 An: 'Richard Marnau'; bacula-users@lists.sourceforge.net Betreff: Re: [Bacula-users] bscan back volumes I had a similar problem when I first used bscan. The answer is at the end of your message Most likely your retention policy pruned the files. What happened was that as soon as the data was bscanned back into the catalog, it was immediately pruned due to the retention policy. Once I changed the retention (file retention and maybe volume retention) period, all went well. Hope this helps. Ken -Original Message- From: Richard Marnau [mailto:mar...@giovannil-nord.de] Sent: Thursday, 28 July 2011 3:32 PM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] bscan back volumes Hi all, i’m trying to bscan back a volume, but the results are always the same: The file index is not restored ☹. What do I miss or how can I check if there has been any file index restored? SCAN: === bscan -s -m -c bacula-sd.conf -P -v -V Y-mond-fd-2011-05-Vol /mnt/backupserver Results: == bscan: bscan.c:637 End of all Volumes. VolFiles=1 VolBlocks=0 VolBytes=5,328,646,644 Records added or updated in the catalog: 1 Media 1 Pool 1 Job 72468 File The output is actually quite interesting. He is trying to build the index and suddenly stops. That's what i don't get .. -- Select FileSet resource (1-2): 2 +---+---+--+---+-+ ---+ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName| +---+---+--+---+-+ ---+ | 3,003 | F | 72,468 | 5,324,390,746 | 2011-05-24 08:27:02 | Y- mond-fd-2011-05-Vol | +---+---+--+---+-+ ---+ You have selected the following JobId: 3003 Building directory tree for JobId(s) 3003 ... For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. --- Thanks a lot in advanced for all hints .. Cheers Richard -- Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users - No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1390 / Virus Database: 1518/3792 - Release Date: 07/27/11 -- Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bscan back volumes
On Thu, 28 Jul 2011 10:32:26 +0200, Richard Marnau said: Hi all, i’m trying to bscan back a volume, but the results are always the same: The file index is not restored ☹. What do I miss or how can I check if there has been any file index restored? SCAN: === bscan -s -m -c bacula-sd.conf -P -v -V Y-mond-fd-2011-05-Vol /mnt/backupserver Results: == bscan: bscan.c:637 End of all Volumes. VolFiles=1 VolBlocks=0 VolBytes=5,328,646,644 Records added or updated in the catalog: 1 Media 1 Pool 1 Job 72468 File The output is actually quite interesting. He is trying to build the index and suddenly stops. That's what i don't get .. -- Select FileSet resource (1-2): 2 +---+---+--+---+-+-- -+ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName| +---+---+--+---+-+-- -+ | 3,003 | F | 72,468 | 5,324,390,746 | 2011-05-24 08:27:02 | Y-mond-fd-2011-05-Vol | +---+---+--+---+-+-- -+ You have selected the following JobId: 3003 Building directory tree for JobId(s) 3003 ... For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. Maybe it is bug 1558? http://bugs.bacula.org/view.php?id=1558 http://adsm.org/lists/html/Bacula-users/2010-04/msg00500.html __Martin UPDATE Job SET PurgedFiles=0 WHERE JobId = 3003; That did the trick, thanks a million martin! -- Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] bscan back volumes
I did create a new database and did the same bscan, this one was working. Job/volume/pool is set to 365 days in the pool configuration. Just wondering: If the client file retention is still default and the pools file retention is set, Which one will actually be in action? I guess the shorter one (client default 60 days?) Oops, wrong link. See [1]. 1. http://www.mail-archive.com/bacula- us...@lists.sourceforge.net/msg42297.html Thanks for the link - that is now explaining why the file index was deleted. But what is the conclusion? Setting Client retention to a high standard or disable it completely (autoprune=no)? Right now I do manage the retention through the pool (full-pool, diff-pool, inc-pool) and as far as I understand this is not working reliable. Cheers, Richard -- Got Input? Slashdot Needs You. Take our quick survey online. Come on, we don't ask for help often. Plus, you'll get a chance to win $100 to spend on ThinkGeek. http://p.sf.net/sfu/slashdot-survey ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Backup Folders using Wild and RegExDir
Hi all, I'm trying to backup Desktop and Documents from all users on a client. Bacula manual is a good point to start / Page 172 does have an example to backup only pictures folders from Windows Clients. Unfortunaly all backups and settings I tried did not include any of the files or folders (or to much of them). Directorys to backup: C:/Dokumente und Einstellungen/*/Desktop/* C:/Dokumente und Einstellungen/*/Eigene Dateien/* -- My FileSet: FileSet { Name = ClientWindows Include { File = C:/Dokumente und Einstellungen Options { signature = MD5 compression = GZIP IgnoreCase = yes #Alle Benutzerverzeichnise mit einbeziehen. RegExDir=^C:/Dokumente und Einstellungen/[^/]+$ #Alle Benutzer Desktop Verzeichnise und Unterverzeichnise Wild = C:/Dokumente und Einstellungen/*/Desktop/* #Alle Benutzer Eigene Dateien und Unterverzeichnise Wild = C:/Dokumente und Einstellungen/*/Eigene Dateien/* } Options { Exclude = yes IgnoreCase = yes Wild= C:/Dokumente und Einstellungen/* } } } Where is my mistake and why ? Thanks for any hint. Cheers, Richard -- Storage Efficiency Calculator This modeling tool is based on patent-pending intellectual property that has been used successfully in hundreds of IBM storage optimization engage- ments, worldwide. Store less, Store more with what you own, Move data to the right place. Try It Now! http://www.accelacomm.com/jaw/sfnl/114/51427378/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bscan a job back..
Hi, i would like to bscan an old archive back into bacula. Name: Vol0029 Size: 50GB, File Based bls -j -V Vol0039 Backup-Long -- 11-May 13:36 bls JobId 0: Ready to read from volume Vol0039 on device Backup-Long (/mnt/backup-long). Volume Record: File:blk=0:185 SessId=64 SessTime=128860 JobId=0 DataLen=150 Begin Job Session Record: File:blk=0:64697 SessId=64 SessTime=128860 JobId=1047 Job=Maximum.2010-11-07_23.05.00_06 Date=08-Nov-2010 00:48:01 Level=F Type=B -- bscan -c /etc/bacula/bacula-sd.conf -p -s -m -S -v -u bacula -P example -V Vol0039 Backup-Long bscan: butil.c:281 Using device: Backup-Long for reading. 11-May 13:38 bscan JobId 0: Ready to read from volume Vol0039 on device Backup-Long (/mnt/backup-long). bscan: bscan.c:296 First Volume Size = 53687078121 bscan: bscan.c:308 Using Database: bacula, User: bacula bscan: bscan.c:450 Pool record for File found in DB. bscan: bscan.c:464 Pool type Backup is OK. bscan: bscan.c:474 Media record for Vol0039 found in DB. bscan: bscan.c:492 Media type File is OK. bscan: bscan.c:502 VOL_LABEL: OK for Volume: Vol0039 bscan: bscan.c:526 SOS_LABEL: Job record not found for JobId: 0 - bscan: bscan.c:966 Updated Media record at end of Volume: Vol0039 bscan: bscan.c:637 End of all Volumes. VolFiles=12 VolBlocks=0 VolBytes=53,657,102,823 Records would have been added or updated in the catalog: 1 Media 1 Pool 1 Job 205361 File -- The Problem is that bacula still does not know anything about the job Job=Maximum.2010-11-07_23.05.00_06, and I still cannot recover anything . which point do I miss ? Cheers, Richard -- Richard Marnau Leitung IT und Projektmanagement FON # 49 431 908959 20 FAX # 49 431 908959 49 MOBIL # 49 178 1377896 MAIL: mar...@giovannil-nord.de Giovanni L. Produktions- Handelsgesellschaft mbH Co. KG UST.-IDNR. DE 274828140 Handelsregister: Amtsgericht Kiel HRA 7266 Komplementär: Giovanni L. International GmbH, 24113 Kiel Amtsgericht Kiel HRB 10939. Geschäftsführender Gesellschafter: Jörg Fischer Gechäftsführer: Peter Zantopp Sitz der Gesellschaften: Mühlendamm 1-13 - 24113 Kiel -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Removing purged volumes form database
Hi, for some reason old backups are still in the database, even if they are purged. | 635 | Vol0635| Purged| 1 |928,733,695 | 0 |7,776,000 | 0 |0 | 0 | File | 2010-10-11 23:47:09 | | 636 | Vol0636| Purged| 1 |562,976 | 0 |7,776,000 | 0 |0 | 0 | File | 2010-10-11 23:47:53 | | 637 | Vol0637| Purged| 1 | 1,240,464 | 0 |7,776,000 | 0 |0 | 0 | File | 2010-10-11 23:48:54 | | 638 | Vol0638| Purged| 1 |106,572,432 | 0 |7,776,000 | 0 |0 | 0 | File | 2010-10-11 23:52:54 | Pool configuration: -- Pool { Name = File Pool Type = Backup Recycle = no# Volumes nicht wieder verwenden. AutoPrune = yes # Prune expired volumes Action on Purge = Truncate # Loeschen Volume Retention = 90 days # File Retention = 90 days # Job Retention = 90 days# Maximum Volume Bytes = 20G # Limit Volume size to something reasonable Maximum Volumes = 900 # Limit number of Volumes in Pool LabelFormat = Vol } I've tried to update the volumes, the pool and the statistics as suggested by the documentation, but the volumes are still in the list. What do I miss ? Cheers, Richard -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Removing purged volumes form database
Am 12.05.2011 13:14, schrieb Richard Marnau: Hi, for some reason old backups are still in the database, even if they are purged. | 635 | Vol0635| Purged| 1 |928,733,695 |0 |7,776,000 | 0 |0 | 0 | File | 2010-10-11 23:47:09 | | 636 | Vol0636| Purged| 1 |562,976 |0 |7,776,000 | 0 |0 | 0 | File | 2010-10-11 23:47:53 | | 637 | Vol0637| Purged| 1 | 1,240,464 |0 |7,776,000 | 0 |0 | 0 | File | 2010-10-11 23:48:54 | | 638 | Vol0638| Purged| 1 |106,572,432 |0 |7,776,000 | 0 |0 | 0 | File | 2010-10-11 23:52:54 | Pool configuration: -- Pool { Name = File Pool Type = Backup Recycle = no# Volumes nicht wieder verwenden. AutoPrune = yes # Prune expired volumes Action on Purge = Truncate # Loeschen Volume Retention = 90 days # File Retention = 90 days # Job Retention = 90 days# Maximum Volume Bytes = 20G # Limit Volume size to something reasonable Maximum Volumes = 900 # Limit number of Volumes in Pool LabelFormat = Vol } I've tried to update the volumes, the pool and the statistics as suggested by the documentation, but the volumes are still in the list. What do I miss ? Cheers, Richard Hi, purging only removes all jobs and files associated to that volume from the database. To get rid of the volume itself, you have to delete it (echo delete volume=volume name | bconsole). Regards, Christian Manal Thanks for making that clear - i thought the database entry itself is deleted as well. Cheers, Richard -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to automatically Purge Volumes if they are older than their Volume Retention time
I've read that update Long Termin Statistik should do the job. But never tried that ;-). -Ursprüngliche Nachricht- Von: ml ml [mailto:mliebher...@googlemail.com] Gesendet: Donnerstag, 10. Februar 2011 12:27 An: bacula-users@lists.sourceforge.net Betreff: [Bacula-users] How to automatically Purge Volumes if they are older than their Volume Retention time Hello List, I am using bacula as a disk-based backup tool. I would now like to automatically purge Volumes when they are older than their Volume Retention time. Otherwise those old Volumes will eat up my disk space before they get reused again. I need them in Purged status so that i can automatically truncate them. However, Automatic recycling of Volumes is performed by Bacula only when it wants a new Volume and no appendable Volumes are available in the Pool. Is there a way to automatically mark them purged if they are older than their Volume Retention time? Cheers, Mario --- --- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen. Find and fix more than 250 security defects in the development cycle. Locate bottlenecks in serial and parallel code that limit performance. http://p.sf.net/sfu/intel-dev2devfeb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE: Pinpoint memory and threading errors before they happen. Find and fix more than 250 security defects in the development cycle. Locate bottlenecks in serial and parallel code that limit performance. http://p.sf.net/sfu/intel-dev2devfeb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring old file - Filling DB with FileRecords using bscan
On Wed, 2 Feb 2011 16:13:49 +0100, Richard Marnau said: 2. = Bscan the related archives === bscan -p -s -v -P -h localhost Backupserver -V Vol0039\|Vol0045\|Vol0094 Records would have been added or updated in the catalog: 3 Media 3 Pool 54 Job 352620 File root@mond:~# bconsole Connecting to Director localhost:9101 === But still I cannot browse the files on the volume... For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. It could be this bug: http://www.mail-archive.com/bacula- us...@lists.sourceforge.net/msg44944.html Hi Martin, thanks for the hint. Well .. I still can't browse the files :-(. I did now: 1. checked JobID 1631 - Volumes Yearly0887/Yearly0898 are needed 2. bscan -c bacula-sd.conf -p -s -m -v -P xx -V Yearly0887\|Yearly0898 Backupserver 3. Went into database, selected job, selected ID 1631, replaced purged files from 1 to 0 4. query show files for job id: Choose a query (1-20): 12 Enter JobId: 1631 No results to list. Please find below the full output of bscan. . is there anything else I can do except banging my head on the table :) ? Cheers, Richard root@mond:/mnt/backupserver# bscan -c bacula-sd.conf -p -s -m -v -P xx -V Yearly0887\|Yearly0898 Backupserver bscan: butil.c:281 Using device: Backupserver for reading. 04-Feb 09:26 bscan JobId 0: Ready to read from volume Yearly0887 on device Backupserver (/mnt/backupserver). bscan: bscan.c:308 Using Database: bacula, User: bacula bscan: bscan.c:450 Pool record for YearlyRotation found in DB. bscan: bscan.c:464 Pool type Backup is OK. bscan: bscan.c:474 Media record for Yearly0887 found in DB. bscan: bscan.c:492 Media type File is OK. bscan: bscan.c:502 VOL_LABEL: OK for Volume: Yearly0887 bscan: bscan.c:582 Could not find SessId=213 SessTime=1292244038 for EOS record. bscan: bscan.c:510 50393 errors ignored before first Start of Session record. bscan: bscan.c:520 SOS_LABEL: Found Job record for JobId: 1631 bscan: bscan.c:683 32,768 file records. At file:blk=1:890,725,023 bytes=5,182,796,039 bscan: bscan.c:683 65,536 file records. At file:blk=2:660,465,148 bytes=9,245,196,719 bscan: bscan.c:683 98,304 file records. At file:blk=5:2,858,339,419 bytes=24,319,578,884 bscan: bscan.c:683 131,072 file records. At file:blk=9:1,831,629,578 bytes=40,463,718,543 bscan: bscan.c:683 163,840 file records. At file:blk=11:1,718,184,297 bytes=48,935,456,877 04-Feb 11:37 bscan JobId 0: End of Volume at file 12 on device Backupserver (/mnt/backupserver), Volume Yearly0887|Yearly0898 bscan: bscan.c:337-1631 == JobId=0 bscan: bscan.c:337-1631 == JobId=1631 bscan: bscan.c:342 Create JobMedia for Job Maximum.2011-01-02_23.05.00_06 bscan: bscan.c:966 Updated Media record at end of Volume: Yearly0887 04-Feb 11:37 bscan JobId 0: Ready to read from volume Yearly0898 on device Backupserver (/mnt/backupserver). bscan: bscan.c:450 Pool record for YearlyRotation found in DB. bscan: bscan.c:464 Pool type Backup is OK. bscan: bscan.c:474 Media record for Yearly0898 found in DB. bscan: bscan.c:492 Media type File is OK. bscan: bscan.c:502 VOL_LABEL: OK for Volume: Yearly0898 bscan: bscan.c:683 196,608 file records. At file:blk=0:1,624,476,842 bytes=1,623,549,713 bscan: bscan.c:683 229,376 file records. At file:blk=2:1,373,556,560 bytes=9,957,923,649 04-Feb 12:06 bscan JobId 0: Error: block.c:318 Volume data error at 2:3252790939! Block checksum mismatch in block=980707 len=10148: calc=54f61d3 blk=9925bac 04-Feb 12:06 bscan JobId 0: Warning: record.c:564 Sanity check failed. maxlen=200 datalen=1913571990. Block discarded. bscan: bscan.c:520 SOS_LABEL: Found Job record for JobId: 1633 04-Feb 12:06 bscan JobId 0: Warning: record.c:564 Sanity check failed. maxlen=200 datalen=-555247637. Block discarded. bscan: bscan.c:520 SOS_LABEL: Found Job record for JobId: 1634 bscan: bscan.c:683 262,144 file records. At file:blk=2:3,526,814,504 bytes=12,109,937,230 04-Feb 12:07 bscan JobId 0: Warning: record.c:564 Sanity check failed. maxlen=200 datalen=1017963697. Block discarded. bscan: bscan.c:520 SOS_LABEL: Found Job record for JobId: 1635 04-Feb 12:08 bscan JobId 0: Warning: record.c:564 Sanity check failed. maxlen=200 datalen=-905085423. Block discarded. bscan: bscan.c:520 SOS_LABEL: Found Job record for JobId: 1647 bscan: bscan.c:683 294,912 file records. At file:blk=3:1,344,909,898 bytes=14,221,845,509 bscan: bscan.c:683 327,680 file records. At file:blk=3:3,149,955,489 bytes=16,025,909,097 bscan: bscan.c:683 360,448 file records. At file:blk=4:2,301,218,998 bytes=19,470,174,307 bscan: bscan.c:683 393,216 file records. At file:blk=4:3,898,406,943 bytes=21,066,467,005 04-Feb 12:31 bscan JobId 0: Warning: record.c:564 Sanity check failed. maxlen=200 datalen=1342355473. Block discarded. bscan: bscan.c:520
Re: [Bacula-users] Restoring old file - Filling DB with FileRecords using bscan
On Wed, 2 Feb 2011 16:13:49 +0100, Richard Marnau said: 2. = Bscan the related archives === bscan -p -s -v -P -h localhost Backupserver -V Vol0039\|Vol0045\|Vol0094 Records would have been added or updated in the catalog: 3 Media 3 Pool 54 Job 352620 File root@mond:~# bconsole Connecting to Director localhost:9101 === But still I cannot browse the files on the volume... For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. It could be this bug: http://www.mail-archive.com/bacula- us...@lists.sourceforge.net/msg44944.html Martin, thanks for the hint. I will check that .. == Could it be related to the following output? bscan: bscan.c:637 End of all Volumes. VolFiles=10 VolBlocks=0 VolBytes=44,246,214,007 02-Feb 15:27 bscan JobId 0: Error: 47 block read errors not printed. That might cause a few missing files, but the majority should be available. Are these tape or disk volumes? Disk Volumes on an smb share (software raid1). I already checked the harddrives, but they seems to be fine. Something is very odd with my database. I walk through yesterday backups but not even 1 week old volumes. === Select the Client (1-25): 18 Automatically selected FileSet: FullWindows +---+---+--++-+-+ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName | +---+---+--++-+-+ | 1,631 | F | 232,077 | 63,158,041,709 | 2011-01-03 00:46:38 | Yearly0887 | | 1,631 | F | 232,077 | 63,158,041,709 | 2011-01-03 00:46:38 | Yearly0898 | | 1,915 | D | 12,237 | 5,763,031,019 | 2011-01-31 00:11:23 | Monthly0901 | +---+---+--++-+-+ You have selected the following JobIds: 1631,1915 Building directory tree for JobId(s) 1631,1915 ... ++ -- For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. === I did now setup a new bacula server and try rebuild the database using bscan. It's a good exercise anyway, but I really need to fix and understand the main problem. There is nothing worse than a unreliable backup system. Thanks for every hint. Richard -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restoring old file - Filling DBwith FileRecords using bscan
On Thu, Feb 03, 2011 at 03:21:35PM +0100, Richard Marnau wrote: On Wed, 2 Feb 2011 16:13:49 +0100, Richard Marnau said: 2. = Bscan the related archives === bscan -p -s -v -P -h localhost Backupserver -V Vol0039\|Vol0045\|Vol0094 Records would have been added or updated in the catalog: 3 Media 3 Pool 54 Job 352620 File root@mond:~# bconsole Connecting to Director localhost:9101 === But still I cannot browse the files on the volume... For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. It could be this bug: http://www.mail-archive.com/bacula- us...@lists.sourceforge.net/msg44944.html Martin, thanks for the hint. I will check that .. == Could it be related to the following output? bscan: bscan.c:637 End of all Volumes. VolFiles=10 VolBlocks=0 VolBytes=44,246,214,007 02-Feb 15:27 bscan JobId 0: Error: 47 block read errors not printed. That might cause a few missing files, but the majority should be available. Are these tape or disk volumes? Disk Volumes on an smb share (software raid1). I already checked the harddrives, but they seems to be fine. Something is very odd with my database. I walk through yesterday backups but not even 1 week old volumes. === Select the Client (1-25): 18 Automatically selected FileSet: FullWindows +---+---+--++-+-- ---+ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName | +---+---+--++-+-- ---+ | 1,631 | F | 232,077 | 63,158,041,709 | 2011-01-03 00:46:38 | Yearly0887 | | 1,631 | F | 232,077 | 63,158,041,709 | 2011-01-03 00:46:38 | Yearly0898 | | 1,915 | D | 12,237 | 5,763,031,019 | 2011-01-31 00:11:23 | Monthly0901 | +---+---+--++-+-- ---+ You have selected the following JobIds: 1631,1915 Building directory tree for JobId(s) 1631,1915 ... ++ -- For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. === I did now setup a new bacula server and try rebuild the database using bscan. It's a good exercise anyway, but I really need to fix and understand the main problem. There is nothing worse than a unreliable backup system. What have you got set for 'File retention'? From the pool: Volume Retention = 370 days # one year File Retention = 370 days # one year Job Retention = 370 days# one year From bconsole: Pool: YearlyRotation +-++---+-++--+--+-+--+---+---+-+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-++--+--+-+--+---+---+-+ | 865 | Vol0865| Used | 1 |509,904,466 |0 | 11,232,000 | 0 |0 | 0 | File | 2010-11-03 23:50:40 | | 887 | Yearly0887 | Full | 1 | 53,687,038,081 | 12 | 31,968,000 | 1 |0 | 0 | File | 2011-01-03 03:18:35 | | 894 | Yearly0894 | Full | 1 | 53,687,043,318 | 12 | 31,968,000 | 1 |0 | 0 | File | 2010-12-06 02:06:16 | | 895 | Yearly0895 | Full | 1 | 53,687,032,874 | 12 | 31,968,000 | 1 |0 | 0 | File | 2011-01-03 00:39:27 | | 898 | Yearly0898 | Append| 1 | 23,144,111,901 |5 | 31,968,000 | 1 |0 | 0 | File | 2011-01-29 02:50:53 | +-++---+-++--+--+-+--+---+---+-+ From the Job: 03-Jan 03:53 mond-dir JobId 1631: Begin pruning Jobs older than 1 year 5 days . 03-Jan 03:53 mond-dir JobId 1631: No Jobs found to prune. 03-Jan 03:53 mond-dir JobId 1631: Begin pruning Jobs. 03-Jan 03:53 mond-dir JobId 1631: No Files found to prune. 03-Jan 03:53 mond-dir JobId 1631: End auto prune. ... that's what I don't get. I proberly miss something but where is the file index gone ?!?! --- --- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price- free! Download using promo code
Re: [Bacula-users] Restoring old file - Filling DBwith FileRecordsusing bscan
On Thu, Feb 03, 2011 at 03:52:15PM +0100, Richard Marnau wrote: On Thu, Feb 03, 2011 at 03:21:35PM +0100, Richard Marnau wrote: On Wed, 2 Feb 2011 16:13:49 +0100, Richard Marnau said: 2. = Bscan the related archives === bscan -p -s -v -P -h localhost Backupserver -V Vol0039\|Vol0045\|Vol0094 Records would have been added or updated in the catalog: 3 Media 3 Pool 54 Job 352620 File root@mond:~# bconsole Connecting to Director localhost:9101 === But still I cannot browse the files on the volume... For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. It could be this bug: http://www.mail-archive.com/bacula- us...@lists.sourceforge.net/msg44944.html Martin, thanks for the hint. I will check that .. == Could it be related to the following output? bscan: bscan.c:637 End of all Volumes. VolFiles=10 VolBlocks=0 VolBytes=44,246,214,007 02-Feb 15:27 bscan JobId 0: Error: 47 block read errors not printed. That might cause a few missing files, but the majority should be available. Are these tape or disk volumes? Disk Volumes on an smb share (software raid1). I already checked the harddrives, but they seems to be fine. Something is very odd with my database. I walk through yesterday backups but not even 1 week old volumes. === Select the Client (1-25): 18 Automatically selected FileSet: FullWindows +---+---+--++ -+-- ---+ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName | +---+---+--++ -+-- ---+ | 1,631 | F | 232,077 | 63,158,041,709 | 2011-01-03 00:46:38 | Yearly0887 | | 1,631 | F | 232,077 | 63,158,041,709 | 2011-01-03 00:46:38 | Yearly0898 | | 1,915 | D | 12,237 | 5,763,031,019 | 2011-01-31 00:11:23 | Monthly0901 | +---+---+--++ -+-- ---+ You have selected the following JobIds: 1631,1915 Building directory tree for JobId(s) 1631,1915 ... ++ -- For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. === I did now setup a new bacula server and try rebuild the database using bscan. It's a good exercise anyway, but I really need to fix and understand the main problem. There is nothing worse than a unreliable backup system. What have you got set for 'File retention'? From the pool: Volume Retention = 370 days # one year File Retention = 370 days # one year Job Retention = 370 days# one year From bconsole: Pool: YearlyRotation +-++---+-++-- +--+-+--+---+---+-- ---+ | MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten | +-++---+-++-- +--+-+--+---+---+-- ---+ | 865 | Vol0865| Used | 1 |509,904,466 | 0 | 11,232,000 | 0 |0 | 0 | File | 2010-11-03 23:50:40 | | 887 | Yearly0887 | Full | 1 | 53,687,038,081 | 12 | 31,968,000 | 1 |0 | 0 | File | 2011-01-03 03:18:35 | | 894 | Yearly0894 | Full | 1 | 53,687,043,318 | 12 | 31,968,000 | 1 |0 | 0 | File | 2010-12-06 02:06:16 | | 895 | Yearly0895 | Full | 1 | 53,687,032,874 | 12 | 31,968,000 | 1 |0 | 0 | File | 2011-01-03 00:39:27 | | 898 | Yearly0898 | Append| 1 | 23,144,111,901 | 5 | 31,968,000 | 1 |0 | 0 | File | 2011-01-29 02:50:53 | +-++---+-++-- +--+-+--+---+---+-- ---+ From the Job: 03-Jan 03:53 mond-dir JobId 1631: Begin pruning Jobs older than 1 year 5 days . 03-Jan 03:53 mond-dir JobId 1631: No Jobs found to prune. 03-Jan 03:53 mond-dir JobId 1631: Begin pruning Jobs. 03-Jan 03:53 mond-dir JobId 1631: No Files found to prune. 03-Jan 03:53 mond-dir JobId 1631: End auto prune. ... that's what I don't get. I proberly miss something but where is the file index gone ?!?! Do the file
[Bacula-users] Restoring old file - Filling DB with File Records using bscan
Hi all, i'm stucked with a small but nasty problem. We need to restore a file which location is known, but the exact filename is not clear. So I need to browse old backups, but the file table has been pruned (for an unknown reason). My steps: 1. Trying to Recover == Date: 2010-12-00 00:00:00 -- Automatically selected FileSet: FullWindows +---+---+--++-++ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName | +---+---+--++-++ | 1,047 | F | 225,597 | 58,975,948,699 | 2010-11-08 00:48:00 | Vol0039| | 1,047 | F | 225,597 | 58,975,948,699 | 2010-11-08 00:48:00 | Vol0045| | 1,188 | D |7,543 | 2,476,679,304 | 2010-11-21 23:59:43 | Vol0094| | 1,197 | I |1,456 | 1,237,777,449 | 2010-11-22 23:36:09 | Vol0094| +---+---+--++-++ You have selected the following JobIds: 1047,1188,1197 Building directory tree for JobId(s) 1047,1188,1197 ... For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. -- 2. = Bscan the related archives === bscan -p -s -v -P -h localhost Backupserver -V Vol0039\|Vol0045\|Vol0094 Records would have been added or updated in the catalog: 3 Media 3 Pool 54 Job 352620 File root@mond:~# bconsole Connecting to Director localhost:9101 === But still I cannot browse the files on the volume... For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. == Could it be related to the following output? bscan: bscan.c:637 End of all Volumes. VolFiles=10 VolBlocks=0 VolBytes=44,246,214,007 02-Feb 15:27 bscan JobId 0: Error: 47 block read errors not printed. = - We do save all volumes to a different file server over the network. Thanks a million for your help, Richard -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula pruing file records ... why ?
Hi Guys, i don't know why bacula is instantly pruning the file records. All volumes are still within the File and JobRetention Period, but I still cannot browse files even from the newest volumes. Any idea? Cheers, Richard Select the Client (1-25): 18 Automatically selected FileSet: FullWindows +---+---+--++-+-+ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName | +---+---+--++-+-+ | 1,631 | F | 232,077 | 63,158,041,709 | 2011-01-03 00:46:38 | Yearly0887 | | 1,631 | F | 232,077 | 63,158,041,709 | 2011-01-03 00:46:38 | Yearly0898 | | 1,915 | D | 12,237 | 5,763,031,019 | 2011-01-31 00:11:23 | Monthly0901 | +---+---+--++-+-+ You have selected the following JobIds: 1631,1915 Building directory tree for JobId(s) 1631,1915 ... ++ For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. Do you want to restore all the files? (yes|no): *show pool=YearlyRotation Pool: name=YearlyRotation PoolType=Backup use_cat=1 use_once=0 cat_files=1 max_vols=100 auto_prune=1 VolRetention=1 year 5 days VolUse=0 secs recycle=1 LabelFormat=Yearly CleaningPrefix=*None* LabelType=0 RecyleOldest=0 PurgeOldest=0 ActionOnPurge=0 MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=53687091200 MigTime=0 secs MigHiBytes=0 MigLoBytes=0 JobRetention=13619 years 3 months 1 day 23 hours 6 mins 40 sec FileRetention=5 years 24 days 9 hours 1 min 20 secs === Pool: name=MonthlyRotation PoolType=Backup use_cat=1 use_once=0 cat_files=1 max_vols=100 auto_prune=1 VolRetention=2 months 5 days VolUse=0 secs recycle=1 LabelFormat=Monthly CleaningPrefix=*None* LabelType=0 RecyleOldest=0 PurgeOldest=0 ActionOnPurge=0 MaxVolJobs=0 MaxVolFiles=0 MaxVolBytes=21474836480 MigTime=0 secs MigHiBytes=0 MigLoBytes=0 JobRetention=13619 years 3 months 1 day 23 hours 6 mins 40 sec FileRetention=5 years 24 days 8 hours 54 mins 48 secs -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula pruing file records ... why ?
Hi Paulo, thanks for your reply, there is no definition what so ever in the client configuration. As i quoted before, only Monthly and Yearly is currently needed when restoring a file older than 2 weeks. Cheers, Richard -- Pool { Name = WeeklyRotation Pool Type = Backup Recycle = yes # Bacula can automatically recycle Volumes AutoPrune = yes # Prune expired volumes # Volume Use Duration = 23h # Ein Volume pro Tag Volume Retention = 15 days # Just over two weeks File Retention = 15 days# Just over two weeks Maximum Volume Bytes = 20G # Limit Vol size to something reasonable Maximum Volumes = 20# Limit number of Volumes in Pool LabelFormat = Weekly } Pool { Name = MonthlyRotation Pool Type = Backup Recycle = yes # Bacula can automatically recycle Volumes AutoPrune = yes # Prune expired volumes Volume Retention = 65 days # Just over two months File Retention = 65 days# Just over two months Maximum Volume Bytes = 20G # Limit Vol size to something reasonable Maximum Volumes = 100 # Limit number of Volumes in Pool LabelFormat = Monthly } Pool { Name = YearlyRotation Pool Type = Backup Recycle = yes # Bacula can automatically recycle Volumes AutoPrune = yes # Prune expired volumes Volume Retention = 370 days # one year File Retention = 370 days # one year Job Retention = 370 days# one year Maximum Volume Bytes = 50G # Limit Vol size to something reasonable Maximum Volumes = 100 # Limit number of Volumes in Pool LabelFormat = Yearly } --- -Ursprüngliche Nachricht- Von: Paulo Martinez [mailto:martinez...@googlemail.com] Gesendet: Montag, 31. Januar 2011 12:58 An: bacula-users Betreff: Re: [Bacula-users] Bacula pruing file records ... why ? Am 31.01.2011 um 10:50 schrieb Richard Marnau: Hi Guys, i don't know why bacula is instantly pruning the file records. All volumes are still within the File and JobRetention Period, but I still cannot browse files even from the newest volumes. Any idea? Where are your retention definitions? they should be in bacula-dir.conf Client { ... Job Retention = x days File Retention = x days ... } Pool { ... Volume Retention = x days # dont put job/file retentions into the pool resource ... } Regards PM --- --- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price- free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Windows 2003 agent performance
I'm having issues with the performance of the bacula agent, 5.0.3 32bit, on Win 2003 32bit installed cleanly in a Virtualbox VM with 4 procs and 3GB ram, with little in use. This machine uses very little cpu under normal load but when a bacula backup starts up the cpu usage climes to 89% but the bacula fd process is only a part of that, the rest is not accounted for, I'm wondering if it is the VSS system. It does not matter if the job is a full or diff job. This VM is hosted on a CentOS 5.5 64bit box with 2 x Quad Zeon and RAID 5. The Bacula server is running on the same CentOS box, also 5.0.3. Everything else is working great with the system, it is only the CPU usage. I'm trying to do an hourly diff so this CPU usage is making the server almost unusable for 5-15 minutes every hour. I'm just looking to see if anyone has seen anything like this and/or has any advice. Thanks!! -- Richard -- Learn how Oracle Real Application Clusters (RAC) One Node allows customers to consolidate database storage, standardize their database environment, and, should the need arise, upgrade to a full multi-node Oracle RAC database without downtime or disruption http://p.sf.net/sfu/oracle-sfdevnl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows 2003 agent performance
Definitely a good point. compression is not turned on though. This is a new system I set up in the past month and I have not enabled software compression anywhere and do not find any references to it in any of my config files. (for that matter I'm not sure if I have hardware compression working on my LTO-4 drive, but I will get to that soon.) One thing I forgot to mention is that these hourly backups are going to a file resource, not tape. That aspect seems to be working fine but just wanted to mention it. Thanks On Wed, 29 Dec 2010 12:01:15 -0800, John Drescher dresche...@gmail.com wrote: On Wed, Dec 29, 2010 at 2:10 PM, Richard Amerman ramer...@roadmasterinc.com wrote: I'm having issues with the performance of the bacula agent, 5.0.3 32bit, on Win 2003 32bit installed cleanly in a Virtualbox VM with 4 procs and 3GB ram, with little in use. Is it acceptable to turn software compression off? John -- Richard Amerman Roadmaster * ramer...@roadmasterinc.com * 360-896-0407 -- Learn how Oracle Real Application Clusters (RAC) One Node allows customers to consolidate database storage, standardize their database environment, and, should the need arise, upgrade to a full multi-node Oracle RAC database without downtime or disruption http://p.sf.net/sfu/oracle-sfdevnl ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unable to restore jobs created on one client, on another
Richard Scobie wrote: Bacula 5.0.2 Linux. Summary: Backup of Box A was done to Storage Daemon backup1 Update slots performed after tape removal Tape was then moved to Storage Daemon flash Fatal errors when attempting to restore files and requested tape mounted: 21-Oct 12:01 library1-dir JobId 466: Start Restore Job RestoreFiles.2010-10-21_12.00.58_04 21-Oct 12:05 library1-dir JobId 466: Using Device flash_LTO-4 21-Oct 12:05 flash-sd JobId 466: Fatal error: No Volume names found for restore. 21-Oct 12:05 flash-fd JobId 466: Fatal error: job.c:2004 Bad response to Read Data command. Wanted 3000 OK data , got 3000 error 21-Oct 12:05 library1-dir JobId 466: Using Device Drive-1 21-Oct 12:05 flash-fd JobId 466: Fatal error: Failed to authenticate Storage daemon. 21-Oct 12:05 library1-dir JobId 466: Fatal error: Bad response to Storage command: wanted 2000 OK storage , got 2902 Bad storage For what it's worth, this problem still occurs after an update to 5.0.3 and a catalog restore from 2 months back. Regards, Richard -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Unable to restore jobs created on one client, on another
Bacula 5.0.2 Linux. I have a number of Jobs, written to LTO4 tape on a host, backup1, which I am trying to restore from with the tapes loaded in a host called flash. Director is running on host library1. These restores are failing with either an error: RestoreFiles.2010-10-21_13.54.01_08is waiting on max Storage jobs, and there are no other jobs pending, or fail completely with Fatal Error. All bacula fds,sds and director have been restarted a number of times. Below is a typical fatal error scenario: restore jobid=345 client=backup1-fd_arc file=?restore_476707713_16 done 1 file selected to be restored. Bootstrap records written to /var/bacula/library1-dir.restore.1.bsr The job will require the following Volume(s) Storage(s)SD Device(s) === AR0030L4 HP_MSL2024HP_MSL2024 NOTE: HP_MSL2024 is attached to backup1 and job is modified to set flash as the restore client and storage: .mod restoreclient=flash-fd_arc fileset=Full Set storage=flash_LTO-4 replace=always when=2010-10-21 12:00:30 bootstrap=/var/bacula/library1-dir.restore.1.bsr where=/mnt/storage1/share/bacula/restores priority=10 yes Job queued. JobId=466 NOTE: A status shows: Select daemon type for status (1-4): library1-dir Version: 5.0.2 (28 April 2010) x86_64-unknown-linux-gnu redhat Daemon started 21-Oct-10 11:56, 0 Jobs run since started. Heap: heap=135,168 smbytes=85,035 max_bytes=1,096,857 bufs=360 max_bufs=365 Full Backup 1122-Oct-10 09:10 BackupCatalog Catalog2 466 RestoreFiles.2010-10-21_12.00.58_04is waiting on Storage flash_LTO-4 NOTE: the requested volume is then mounted: Select Storage resource (1-3): 3001 Mounted Volume: AR0030L4 3001 Device flash_LTO-4 (/dev/nst0) is mounted with Volume AR0030L4 NOTE: At this point the job fails with a fatal error. 21-Oct 12:01 library1-dir JobId 466: Start Restore Job RestoreFiles.2010-10-21_12.00.58_04 21-Oct 12:05 library1-dir JobId 466: Using Device flash_LTO-4 21-Oct 12:05 flash-sd JobId 466: Fatal error: No Volume names found for restore. 21-Oct 12:05 flash-fd JobId 466: Fatal error: job.c:2004 Bad response to Read Data command. Wanted 3000 OK data , got 3000 error 21-Oct 12:05 library1-dir JobId 466: Using Device Drive-1 21-Oct 12:05 flash-fd JobId 466: Fatal error: Failed to authenticate Storage daemon. 21-Oct 12:05 library1-dir JobId 466: Fatal error: Bad response to Storage command: wanted 2000 OK storage , got 2902 Bad storage 21-Oct 12:05 library1-dir JobId 466: Error: Bacula library1-dir 5.0.2 (28Apr10): 21-Oct-2010 12:05:07 Build OS: x86_64-unknown-linux-gnu redhat JobId: 466 Job:RestoreFiles.2010-10-21_12.00.58_04 Restore Client: flash-fd_arc Start time: 21-Oct-2010 12:01:00 End time: 21-Oct-2010 12:05:07 Files Expected: 1 Files Restored: 0 Bytes Restored: 0 Rate: 0.0 KB/s FD Errors: 0 FD termination status: SD termination status: Waiting on FD Termination:*** Restore Error *** 21-Oct 12:05 library1-dir JobId 466: Error: Bacula library1-dir 5.0.2 (28Apr10): 21-Oct-2010 12:05:07 Build OS: x86_64-unknown-linux-gnu redhat JobId: 466 Job:RestoreFiles.2010-10-21_12.00.58_04 Restore Client: flash-fd_arc Start time: 21-Oct-2010 12:01:00 End time: 21-Oct-2010 12:05:07 Files Expected: 1 Files Restored: 0 Bytes Restored: 0 Rate: 0.0 KB/s FD Errors: 1 FD termination status: SD termination status: Waiting on FD Termination:*** Restore Error *** I don't understand here why it attempts to use Drive-1, which is the drive on the creation host, backup1. Am I missing something basic here? All the jobs tried restore OK on backup1, where they were created. Regards, Richard -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unable to restore jobs created on one client, on another
Dan Langille wrote: I don't understand here why it attempts to use Drive-1, which is the drive on the creation host, backup1. My guess: because that's where the Catalog says is it? A list media for the Archive pool shows the In changer and Slot flag for AR0030L4 to be 0. Regards, Richard -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Unable to restore jobs created on one client, on another
Dan Langille wrote: Instead, what you're saying is: - backup of Box A was done to Storage Daemon backup1 - tape was then moved to Storage Daemon flash Yes, sorry for the confusion. Does the Director know that the tape has moved from one system to another? Only in the sense that once the tapes were removed from backup1's autoloader, the command update slots was done. Is there something else that needs doing? Regards, Richard -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula with two independent storage and pools
Hi all, our backup server is in the same room like all the other servers and just to make sure I want to backup some server on separate usb disks. So far so easy. The setup: [storage1] - [Pool1] - [JOB1,2,3,4,5,6] [storage2] - [Pool2] - [D-Job1,2,3,4,5,6] I did define a separate storage with a separate pool and created separate jobs for each server. Everything is working so far but bacula is mixing up the archives when I want to do a restore. === SNIP === Full Recovery: Automatically selected FileSet: FullLinux +---+---+--++-++ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName | +---+---+--++-++ | 463 | F | 91,974 | 19,934,664,291 | 2010-09-12 00:55:10 | Archiv1 | --- USB-Full-Archiv, wrong SD and Pool | 550 | D | 15,186 | 12,726,800,679 | 2010-09-19 23:21:42 | Vol0413| | 558 | I |3,382 |572,511,925 | 2010-09-20 23:20:24 | Vol0421| | 569 | I |7,297 |186,410,950 | 2010-09-21 23:20:51 | Vol0429| | 577 | I |3,878 |594,435,445 | 2010-09-22 23:20:28 | Vol0437| | 585 | I |2,634 |187,140,431 | 2010-09-23 23:20:37 | Vol0445| +---+---+--++-++ === SNAPP === Archiv1 was the last full backup on the USB archive disk, not the last full backup on the normal backup server. Couple of reasons why this is bad, but most important I'm way to lazy to swap usb-drives each time a backup occurs ;-). Thanks for any hints... Cheers, Richard -- Nokia and ATT present the 2010 Calling All Innovators-North America contest Create new apps games for the Nokia N8 for consumers in U.S. and Canada $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store http://p.sf.net/sfu/nokia-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Ideas for a backup strategy
David Noriega wrote: both drives and 2) has as much data as these drives can take pouring into them, since this is taking too long to do a backup. I've read a One solution to feed your drives at full speed, is to build a low cost server containing an array of SATA drives, sufficient to hold all that you are backing up, and attach the library to it. Rsync the data you are backing up to it, and do your backup from this array. I have been running a setup like this to backup 11TB of uncompessible data to a single drive LTO4 library and it takes around 27 hours. This also reduces the backup performance impct on your primary storage. Regards, Richard -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Ideas for a backup strategy
David Noriega wrote: Its an idea, but not what I asked. I would have gone with a completely disked based backup, but that kind of hardware is expensive to do it right. I asked about multiplexing. I figure I could take /home and My apologies, I distinctly thought you said as much data as these drives can take pouring into them, since this is taking too long to do a backup. The outlined solution achieves that at a much lower cost than a completely disk based backup system. Regards, Richard -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Autochanger weakness
Full216,1432.334 T OK 21-Jul-10 18:01 Archive-BAK 3510 0 OK 27-Jul-10 11:01 RestoreFiles 3670 0 OK 11-Aug-10 14:38 RestoreFiles 3690 0 OK 12-Aug-10 10:46 RestoreFiles 3700 0 OK 12-Aug-10 10:55 RestoreFiles 3830 0 OK 24-Aug-10 10:27 RestoreFiles 3940 0 Error03-Sep-10 10:24 RestoreFiles Device status: Device FileStorage (/mnt/exp1/bacula) is not open. Device flash_LTO-4 (/dev/nst0) is mounted with: Volume: AR0030L4 Pool:*unknown* Media type: LTO-4 Total Bytes Read=2,048 Blocks Read=2 Bytes/block=1,024 Positioned at File=0 Block=0 Used Volume status: AR0030L4 on device flash_LTO-4 (/dev/nst0) Reader=0 writers=0 devres=0 volinuse=0 Attr spooling: 0 active jobs, 0 bytes; 12 total jobs, 296,418,507 max bytes. Connecting to Client backup1-fd at backup1.sauce.co.nz:9102 backup1-fd Version: 5.0.2 (28 April 2010) x86_64-unknown-linux-gnu redhat Daemon started 02-Sep-10 16:04, 0 Jobs run since started. Heap: heap=0 smbytes=14,056 max_bytes=14,203 bufs=57 max_bufs=58 Sizeof: boffset_t=8 size_t=8 debug=0 trace=0 Running Jobs: Director connected at: 07-Sep-10 07:19 No Jobs running. Terminated Jobs: JobId LevelFiles Bytes Status FinishedName == 268 Full 1,781,81512.59 T OK 16-Jun-10 14:55 backup1-ICE 278 Full 1,854,48812.13 T OK 22-Jun-10 21:02 backup1-ICE 294 Full 1,925,72912.71 T OK 29-Jun-10 13:02 backup1-ICE 306 Full 1,916,27112.46 T OK 06-Jul-10 14:11 backup1-ICE 312 17,019113.8 G OK 07-Jul-10 10:13 RestoreFiles 313 4582.151 G OK 07-Jul-10 10:27 RestoreFiles 328 20,029206.2 G Cancel 14-Jul-10 10:52 RestoreFiles 331 432,1023.121 T OK 14-Jul-10 23:15 RestoreFiles 345 Full 2,355,65211.95 T OK 24-Jul-10 15:36 Archive 349 Full 2,355,65211.95 T OK 28-Jul-10 21:28 Archive-BAK Connecting to Client library1-fd at library1.sauce.co.nz:9102 library1-fd Version: 5.0.2 (28 April 2010) x86_64-unknown-linux-gnu redhat Daemon started 19-Jul-10 08:41, 50 Jobs run since started. Heap: heap=0 smbytes=12,969 max_bytes=151,428 bufs=56 max_bufs=84 Sizeof: boffset_t=8 size_t=8 debug=0 trace=0 Running Jobs: Director connected at: 07-Sep-10 07:19 No Jobs running. Terminated Jobs: JobId LevelFiles Bytes Status FinishedName == 387 Full 11.773 G OK 28-Aug-10 09:21 BackupCatalog 388 Full 11.773 G OK 29-Aug-10 09:21 BackupCatalog 389 Full 11.773 G OK 30-Aug-10 09:21 BackupCatalog 390 Full 11.773 G OK 31-Aug-10 09:21 BackupCatalog 391 Full 11.773 G OK 01-Sep-10 09:20 BackupCatalog 392 Full 11.773 G OK 02-Sep-10 09:21 BackupCatalog 393 Full 11.773 G OK 03-Sep-10 09:21 BackupCatalog 397 Full 11.773 G OK 04-Sep-10 09:20 BackupCatalog 398 Full 11.773 G OK 05-Sep-10 09:20 BackupCatalog 399 Full 11.773 G OK 06-Sep-10 09:20 BackupCatalog Connecting to Client flash-fd at flash.sauce.co.nz:9102 flash-fd Version: 5.0.2 (28 April 2010) x86_64-unknown-linux-gnu redhat Daemon started 25-Jun-10 16:00, 20 Jobs run since started. Heap: heap=524,288 smbytes=12,874 max_bytes=212,903 bufs=56 max_bufs=174 Sizeof: boffset_t=8 size_t=8 debug=0 trace=0 Running Jobs: Director connected at: 07-Sep-10 07:19 No Jobs running. Terminated Jobs: JobId LevelFiles Bytes Status FinishedName == 333 Full213,7132.750 T OK 16-Jul-10 08:49 Archive 334 Full213,7132.750 T OK 16-Jul-10 16:13 Archive-BAK 340 Full216,1432.334 T OK 21-Jul-10 11:37 Archive 342 Full216,1432.334 T OK 21-Jul-10 18:01 Archive-BAK 351298.28 G OK 27-Jul-10 11:01 RestoreFiles 367 10545.17 M OK 11-Aug-10 14:38 RestoreFiles 36941.702 M OK 12-Aug-10 10:46 RestoreFiles 370 1012.95 M OK 12-Aug-10 10:55 RestoreFiles 383 872.011 G OK 24-Aug-10 10:27 RestoreFiles 3940 0 Error03-Sep-10 10:24 RestoreFiles Regards, Richard
Re: [Bacula-users] Autochanger weakness
Richard Scobie wrote: Device status: Device FileStorage (/mnt/exp1/bacula) is not open. Device flash_LTO-4 (/dev/nst0) is mounted with: Volume: AR0030L4 Pool:*unknown* Media type: LTO-4 Total Bytes Read=2,048 Blocks Read=2 Bytes/block=1,024 Positioned at File=0 Block=0 Used Volume status: AR0030L4 on device flash_LTO-4 (/dev/nst0) Reader=0 writers=0 devres=0 volinuse=0 I'm not sure if it is related, but the above from status all shows AR0030L4 in Pool:*unknown*, but a list media clearly shows it in the Archive pool. Regards, Richard -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Autochanger weakness
Unless I have missed something, it appears that if you have an autochanger full of tapes and it becomes unavailable for whatever reason - say the PSU fails, there is no way of accessing the tapes in another drive, as the system thinks are still loaded in the library and will not allow a restore when mounted in another drive, due to update slots not being able to be run. Surely if a tape is mounted in a drive and the label is read, this should become the new location for this tape? Regards, Richard -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Modifying tape location
I have a tape I am trying to restore from on a local LTO drive. It was created at a remote location, in a library which is no longer attached to the SD there and the update slots command was not done after this tape was removed, so the Director still sees the tape as residing in the remote library. How can I change this, so I can mount the tape locally and restore from it? Regards, Richard -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Ignore full backups for offside/desaster recovery
Hi guys, We do have a backup-server with disks where i store the backups. This is working fine, but i do have the concern that a backupserver in the same room is properly not a good idea (O'Reilly BackupRecovery realy scarys you off). I did define another storage+pool to backup on USB Disk with the same schedule. Every month i'm moving the disks to offside locations. Problem: The diffs and the inc backups are on top of the last full backup. How can i prevent bacula from counting the usb-full backup, so that all backups in are on the backup-server? My thoughts: Backups always comes from the backup-server. In case everything burns to ground the disaster recovery comes from full backups with the off-side disks. I don't want to mix them. ### SCHEDULE # Schedule { Name = WeeklyCycle Run = Level=Full Pool=File 1st sun at 23:05 Run = Level=Differential Pool=File 2nd-5th sun at 23:05 Run = Level=Incremental Pool=File mon-sat at 23:05 Run = Level=Full Pool=USB-Pool 2nd wed at 02:00 } Schedule { Name = EinmalDieWocheVoll Run = Level=FullPool=File sun at 2:00 Run = Level=FullPool=USB-Pool 2nd wed at 02:00 } Thanks, Richard -- Sell apps to millions through the Intel(R) Atom(Tm) Developer Program Be part of this innovative community and reach millions of netbook users worldwide. Take advantage of special opportunities to increase revenue and speed time-to-market. Join now, and jumpstart your future. http://p.sf.net/sfu/intel-atom-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Want to contribute to Bacula?
Sorry, that was another of the changes that I had to make. I've got that sitting in the documentation git repo tree and will push that docu change to Kern once I'm happy that I can run without too much changes. You need to add a /bacula to the end of gitroot/bacula e.g. git clone -v git://bacula.git.sourceforge.net/gitroot/bacula/bacula bacula Once you've got that step done with the documentation gets a little confusing it says to run ./config filename.conf but in actual fact you seem to just need to do make setup from the bacula/regress directory. Regards Richard On 23/08/2010 21:49, Andrea Venturoli wrote: Il 08/18/10 00:41, Dan Langille ha scritto: Would you like to contribute to Bacula? The easiest way is running regression testing. Run the tests on a daily basis and submit them to the regression database. Full details are here: http://www.bacula.org/5.0.x-manuals/en/developers/developers/Bacula_Regression_Testing.html See: # Setting up Regession Testing # Running the Regression Script Have a look at http://regress.bacula.org/ and see if your Operating System and database version are tested. If not, it is to your benefit to ensure Bacula is tested against your tools of choice. I'm willing to try this, but: %git clone -v git://bacula.git.sourceforge.net/gitroot/bacula bacula Cloning into bacula... fatal: The remote end hung up unexpectedly Where do I go from here? Is the above correct? bye Thanks av. -- Sell apps to millions through the Intel(R) Atom(Tm) Developer Program Be part of this innovative community and reach millions of netbook users worldwide. Take advantage of special opportunities to increase revenue and speed time-to-market. Join now, and jumpstart your future. http://p.sf.net/sfu/intel-atom-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Sell apps to millions through the Intel(R) Atom(Tm) Developer Program Be part of this innovative community and reach millions of netbook users worldwide. Take advantage of special opportunities to increase revenue and speed time-to-market. Join now, and jumpstart your future. http://p.sf.net/sfu/intel-atom-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Want to contribute to Bacula?
On 23/08/2010 20:16, Bruno Friedmann wrote: On 08/23/2010 09:05 PM, Richard Mortimer wrote: On 21/08/2010 00:51, Richard Mortimer wrote: On 20/08/2010 00:56, Dan Langille wrote: On 8/19/2010 11:29 AM, Richard Mortimer wrote: Hi Dan, On 17/08/2010 23:41, Dan Langille wrote: Would you like to contribute to Bacula? The easiest way is running regression testing. Run the tests on a daily basis and submit them to the regression database. I'll run tests on Ubuntu 10.04 (lucid) because I've got a suitable installation available here. I had a quick try at following the instructions but it didn't work. It is probably a setup problem on my part so I'll try again tonight and will follow up on bacula-devel if I still have problems. I recommend following up here rather than devel. I've got sqlite3 working and uploading results to the experimental area. This worked ok first time. I tried mysql yesterday (that's what I use for my own backups) and most tests seem to fail with that. I suspect it is some database problem because the setup scripts do not seem to be passed the username/password from the regression test configuration. I'll have a look at what is wrong when I get a few minutes over the next couple of days. Ok as I suspected it is the database setup/cleanup scripts that are failing. Nothing is passing the username/password credentials to the appropriate scripts. I suspect it would work for a user regress with database regress and no db password. In any case I have got it to work by dropping the mysql credentials into a file named regressmysql.cnf in the toplevel regress directory and then adding --defaults-file=${cwd}/regressmysql.cnf to the commands that cleanup/tear down the database. I've attached my current changes as a patch file but I'm sure that they need some work to make it suitable for committing to the git repo. The regressmysql.cnf file is currently hand generated and contains regr...@royalcounty:~/bacula/regress$ cat regressmysql.cnf [client] host = localhost user = regress password = passwordgoeshere Regards Richard Regards Richard Richard, why not using the expect db auth file format like a ~regress/.my.cnf or/and regress/.pgpass with exactly the waiting auth scheme by db. I think there's no need to patch if you prepare a convenient and complete db setup for your regress user (same apply to normal bacula) Good idea thanks. I'll give that a whirl. That will certainly be a bit simpler. If that works I'll whip up a patch for the documentation with sample file contents etc. to save others having to search the list archives. Regards Richard -- Sell apps to millions through the Intel(R) Atom(Tm) Developer Program Be part of this innovative community and reach millions of netbook users worldwide. Take advantage of special opportunities to increase revenue and speed time-to-market. Join now, and jumpstart your future. http://p.sf.net/sfu/intel-atom-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Want to contribute to Bacula?
On 21/08/2010 00:51, Richard Mortimer wrote: On 20/08/2010 00:56, Dan Langille wrote: On 8/19/2010 11:29 AM, Richard Mortimer wrote: Hi Dan, On 17/08/2010 23:41, Dan Langille wrote: Would you like to contribute to Bacula? The easiest way is running regression testing. Run the tests on a daily basis and submit them to the regression database. I'll run tests on Ubuntu 10.04 (lucid) because I've got a suitable installation available here. I had a quick try at following the instructions but it didn't work. It is probably a setup problem on my part so I'll try again tonight and will follow up on bacula-devel if I still have problems. I recommend following up here rather than devel. I've got sqlite3 working and uploading results to the experimental area. This worked ok first time. I tried mysql yesterday (that's what I use for my own backups) and most tests seem to fail with that. I suspect it is some database problem because the setup scripts do not seem to be passed the username/password from the regression test configuration. I'll have a look at what is wrong when I get a few minutes over the next couple of days. Ok as I suspected it is the database setup/cleanup scripts that are failing. Nothing is passing the username/password credentials to the appropriate scripts. I suspect it would work for a user regress with database regress and no db password. In any case I have got it to work by dropping the mysql credentials into a file named regressmysql.cnf in the toplevel regress directory and then adding --defaults-file=${cwd}/regressmysql.cnf to the commands that cleanup/tear down the database. I've attached my current changes as a patch file but I'm sure that they need some work to make it suitable for committing to the git repo. The regressmysql.cnf file is currently hand generated and contains regr...@royalcounty:~/bacula/regress$ cat regressmysql.cnf [client] host = localhost user = regress password = passwordgoeshere Regards Richard Regards Richard diff --git a/regress/scripts/cleanup b/regress/scripts/cleanup index d63a52e..b1b14e0 100755 --- a/regress/scripts/cleanup +++ b/regress/scripts/cleanup @@ -22,8 +22,8 @@ if [ -d ${bin} ] ; then ${bin}/bacula stop 21 /dev/null fi cd ${scripts} - ./drop_bacula_tables /dev/null 21 - ./make_bacula_tables /dev/null 21 + ./drop_bacula_tables --defaults-file=${cwd}/regressmysql.cnf /dev/null 21 + ./make_bacula_tables --defaults-file=${cwd}/regressmysql.cnf /dev/null 21 ./grant_bacula_privileges /dev/null 21 cd ${cwd} fi diff --git a/regress/scripts/setup b/regress/scripts/setup index 0a9311c..f80d9c5 100755 --- a/regress/scripts/setup +++ b/regress/scripts/setup @@ -71,10 +71,10 @@ bin/bacula stop mkdir -p working cd bin echo Running database creation scripts -./create_bacula_database -./drop_bacula_tables -./make_bacula_tables -./grant_bacula_privileges +./create_bacula_database --defaults-file=${cwd}/regressmysql.cnf +./drop_bacula_tables --defaults-file=${cwd}/regressmysql.cnf +./make_bacula_tables --defaults-file=${cwd}/regressmysql.cnf +./grant_bacula_privileges --defaults-file=${cwd}/regressmysql.cnf cd ${cwd} # Start and stop Bacula to ensure conf files are OK bin/bacula start diff --git a/regress/tests/accurate-test b/regress/tests/accurate-test index 21ae454..33280fd 100755 --- a/regress/tests/accurate-test +++ b/regress/tests/accurate-test @@ -283,9 +283,9 @@ p Check with bscan stop_bacula cd $bin - ./drop_bacula_tables /dev/null 21 - ./make_bacula_tables /dev/null 21 - ./grant_bacula_privileges /dev/null 21 + ./drop_bacula_tables --defaults-file=${cwd}/regressmysql.cnf /dev/null 21 + ./make_bacula_tables --defaults-file=${cwd}/regressmysql.cnf /dev/null 21 + ./grant_bacula_privileges --defaults-file=${cwd}/regressmysql.cnf /dev/null 21 cd .. echo volume=TestVolume001 tmp/bscan.bsr diff --git a/regress/tests/bscan-fast-tape b/regress/tests/bscan-fast-tape index 7c68a78..ea4fb53 100755 --- a/regress/tests/bscan-fast-tape +++ b/regress/tests/bscan-fast-tape @@ -56,9 +56,9 @@ echo End writing tape # now drop and recreate the database # cd bin -./drop_bacula_tables /dev/null 21 -./make_bacula_tables /dev/null 21 -./grant_bacula_privileges 21 /dev/null +./drop_bacula_tables --defaults-file=${cwd}/regressmysql.cnf /dev/null 21 +./make_bacula_tables --defaults-file=${cwd}/regressmysql.cnf /dev/null 21 +./grant_bacula_privileges --defaults-file=${cwd}/regressmysql.cnf 21 /dev/null cd .. echo Begin attempt to read tape that crashes the system diff --git a/regress/tests/bscan-tape b/regress/tests/bscan-tape index 419fd24..05127da 100755 --- a/regress/tests/bscan-tape +++ b/regress/tests/bscan-tape @@ -89,9 +89,9 @@ echo Backup 4 done # now drop and recreate the database # cd bin -./drop_bacula_tables /dev/null 21 -./make_bacula_tables /dev/null 21 -./grant_bacula_privileges 21 /dev/null +./drop_bacula_tables --defaults-file
Re: [Bacula-users] Want to contribute to Bacula?
On 20/08/2010 00:56, Dan Langille wrote: On 8/19/2010 11:29 AM, Richard Mortimer wrote: Hi Dan, On 17/08/2010 23:41, Dan Langille wrote: Would you like to contribute to Bacula? The easiest way is running regression testing. Run the tests on a daily basis and submit them to the regression database. I'll run tests on Ubuntu 10.04 (lucid) because I've got a suitable installation available here. I had a quick try at following the instructions but it didn't work. It is probably a setup problem on my part so I'll try again tonight and will follow up on bacula-devel if I still have problems. I recommend following up here rather than devel. I've got sqlite3 working and uploading results to the experimental area. This worked ok first time. I tried mysql yesterday (that's what I use for my own backups) and most tests seem to fail with that. I suspect it is some database problem because the setup scripts do not seem to be passed the username/password from the regression test configuration. I'll have a look at what is wrong when I get a few minutes over the next couple of days. Regards Richard -- This SF.net email is sponsored by Make an app they can't live without Enter the BlackBerry Developer Challenge http://p.sf.net/sfu/RIM-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users