[Bacula-users] Bacula job replication to other machine
Dear, We are running the bacula 5.2.6+dfsg-8 on debian. All my backups are on tape (we are using spool directory to increase the tape performance). We want to have another copy of this backups/jobs. Seems that bacula cannot have a second instance (something like a shadow bacula to copy this data/jobs automatically). The most suggested option , looking in the web is to use "rsync", to replicate the volume. i would like to know is the is a way to use to spool directory to replicate the jobs on the fly. Or maybe there is a best way to do this? Thanks in advance. Bertrand Russell: *"El problema con el mundo es que los estúpidos están seguros de todo y los inteligentes están llenos de dudas*" -- Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET Get 100% visibility into your production application - at no cost. Code-level diagnostics for performance bottlenecks with <2% overhead Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap1___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula job replication to other machine
On Thu, May 02, 2013 at 01:56:14PM +0200, Iban Cabrillo wrote: > We are running the bacula 5.2.6+dfsg-8 on debian. All my backups are on > tape (we are using spool directory to increase the tape performance). > The most suggested option , looking in the web is to use "rsync", to > replicate the volume. i would like to know is the is a way to use to spool > directory to replicate the jobs on the fly. > Or maybe there is a best way to do this? Unfortunately bacula can't write the same job on 2 media in one go. I solved a similar scenario for me by doing - Backup to disk - Copy Job to copy the disk-backups to tape pool1 - Copy job to copy the disk-backups to tape pool2 In my setup, the job has a lifetime of 13 months, the disk-pools 35 days, one tape pool 13 months, the other 2 months. If you can afford the diskspace for a set of backups, but not for as many days, you can do a copy job and a migrate job instead of 2 copy jobs or implement some other algorithm to recover the disk space. I use sql to select the jobs I want to copy. Regards, Adrian -- LiHAS - Adrian Reyer - Hessenwiesenstraße 10 - D-70565 Stuttgart Fon: +49 (7 11) 78 28 50 90 - Fax: +49 (7 11) 78 28 50 91 Mail: li...@lihas.de - Web: http://lihas.de Linux, Netzwerke, Consulting & Support - USt-ID: DE 227 816 626 Stuttgart -- Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET Get 100% visibility into your production application - at no cost. Code-level diagnostics for performance bottlenecks with <2% overhead Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Using `Where` on RunScript of a RestoreJob
Hi bacula users,
Given the following restore job scrap:
```
Job {
Name = "RestoreJob"
Type = restore
...
RunScript {
Command = "sh -c 'do something with %where'"
}
}
```
When scheduling a new restore I dynamically set the `Where` property.
I use before/after commands to fix some permissions issues, yet I need to
have a way to dynamically get the `Where` property into my command.
Is there a way to reference `Where` in my RunScript command?
Thanks!
--
Renan Gonçalves aka renan.saddam
Software Engineer at TrueServer B.V.
CakePHP Core Developer
W: renangoncalves.com
T: twitter.com/renan_saddam
M: +31 (0)6 4662 1860
L: Amsterdam, The Netherlands
--
Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET
Get 100% visibility into your production application - at no cost.
Code-level diagnostics for performance bottlenecks with <2% overhead
Download for free and get started troubleshooting in minutes.
http://p.sf.net/sfu/appdyn_d2d_ap1___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Intermitent error.
Greetings. I'm receiving this intermitent error when some random jobs run: 01-May 18:00 backup-dir JobId 8241: Start Backup JobId 8241, Job=job-pampa-mensagem.2013-05-01_18.00.00_24 01-May 18:00 backup-dir JobId 8241: There are no more Jobs associated with Volume "pampa-mensagem-4832". Marking it purged. 01-May 18:00 backup-dir JobId 8241: All records pruned from Volume "pampa-mensagem-4832"; marking it "Purged" 01-May 18:00 backup-dir JobId 8241: Recycled volume "pampa-mensagem-4832" 01-May 18:00 backup-dir JobId 8241: Using Device "FileStorage" 01-May 18:00 backup-sd JobId 8241: Labeled new Volume "pampa-mensagem-4832" on device "FileStorage" (*/storage/backup/*). 01-May 18:00 backup-sd JobId 8241: Wrote label to prelabeled Volume "pampa-mensagem-4832" on device "FileStorage" (*/storage/backup/*) 01-May 18:00 backup-dir JobId 8241: Volume used once. Marking Volume "pampa-mensagem-4832" as Used. 02-May 07:24 backup-sd JobId 8241: Job write elapsed time = 13:24:16, Transfer rate = 5.011 M Bytes/second 02-May 07:24 backup-dir JobId 8241: Fatal error: sql_create.c:858 Fill Path table Query failed: INSERT INTO Path (Path) SELECT a.Path FROM (SELECT DISTINCT Path FROM batch) AS a WHERE NOT EXISTS (SELECT Path FROM Path AS p WHERE p.Path = a.Path): ERR=Table 'batch' is marked as crashed and should be repaired 02-May 07:24 backup-dir JobId 8241: Error: Bacula backup-dir 5.0.1 (24Feb10): 02-May-2013 07:24:48 Build OS: i486-pc-linux-gnu debian squeeze/sid JobId: 8241 Job:job-pampa-mensagem.2013-05-01_18.00.00_24 Backup Level: Full Client: "fd-pampa" 2.4.2 (26Jul08) i486-pc-linux-gnu,debian,lenny/sid FileSet:"mensagem" 2012-03-27 04:30:00 Pool: "pampa-mensagem" (From Job resource) Catalog:"MySQL" (From Client resource) Storage:"File" (From Job resource) Scheduled time: 01-May-2013 18:00:00 Start time: 01-May-2013 18:00:03 End time: 02-May-2013 07:24:48 Elapsed time: 13 hours 24 mins 45 secs Priority: 10 FD Files Written: 2,492,982 SD Files Written: 2,492,982 FD Bytes Written: 241,396,707,567 (241.3 GB) SD Bytes Written: 241,820,635,575 (241.8 GB) Rate: 4999.4 KB/s Software Compression: None VSS:no Encryption: no Accurate: no Volume name(s): pampa-mensagem-4832 Volume Session Id: 345 Volume Session Time:1362770881 Last Volume Bytes: 242,081,463,680 (242.0 GB) Non-fatal FD errors:0 SD Errors: 0 FD termination status: OK SD termination status: OK Termination:*** Backup Error *** 02-May 07:24 backup-dir JobId 8241: Begin pruning Jobs older than 2 months . 02-May 07:24 backup-dir JobId 8241: No Jobs found to prune. 02-May 07:24 backup-dir JobId 8241: Begin pruning Jobs. 02-May 07:24 backup-dir JobId 8241: No Files found to prune. 02-May 07:24 backup-dir JobId 8241: End auto prune. The error ocurred two times in this week in different jobs and is the first time I see this happening on my backup server. Is that what it says on the logs or there is something more hapening? -- Att.* *** Luis H. Forchesatto -- Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET Get 100% visibility into your production application - at no cost. Code-level diagnostics for performance bottlenecks with <2% overhead Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap1___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Intermitent error.
On 05/02/13 09:43, Luis H. Forchesatto wrote: > Greetings. > > I'm receiving this intermitent error when some random jobs run: > ---8< > 02-May 07:24 backup-dir JobId 8241: Fatal error: sql_create.c:858 Fill Path > table Query failed: INSERT INTO Path (Path) SELECT a.Path FROM (SELECT > DISTINCT Path FROM batch) AS a WHERE NOT EXISTS (SELECT Path FROM Path AS p > WHERE p.Path = a.Path): ERR=Table 'batch' is marked as crashed and should be > repaired Hi Louis... I cut that Fatal error line to reveal the cause at the end of the line: ---8< ERR=Table 'batch' is marked as crashed and should be repaired ---8< I believe that your answer. If other jobs fail with other tables being reported as crashed, then they should be repaired as well. I would stop bacula and all other programs accessing your database and run a mysqlcheck on all tables. (Assuming mysql since that looks like a mysql error to me) -- Bill Arlofski Reverse Polarity, LLC -- Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET Get 100% visibility into your production application - at no cost. Code-level diagnostics for performance bottlenecks with <2% overhead Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] backup to multiple disks
Hi everyone, this must be a FAQ but neither TFM nor google are being very helpful... I have a storage server with 12 SATA drives on an HBA. I want to backup to those drives, using file volumes of 50GB or less. The idea is to manually swap the drives as they get full. I'm looking for the implementation with least moving parts. From what I see out there my choices are 1. Autochanger. Can I just omit the "Changer Command =" (or set it to /bin/true) and it'll magically work? Or do I have to have a "fake autochanger" script -- and if I do, how is it supposed to work with 12 drives all mounted at once? E.g. TFM has an example of 2-drive configuration, but it doesn't say what "mtx-chager loaded" is supposed to return in that case. 2. Give each client its own disk. I'll consider it if all else fails, but obviously this is far from optmal. Any suggestions? (Bacula is 5.0.0/centos 6) TIA -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET Get 100% visibility into your production application - at no cost. Code-level diagnostics for performance bottlenecks with <2% overhead Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap1___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
On Thu, May 2, 2013 at 1:39 PM, Dimitri Maziuk wrote: > Hi everyone, > > this must be a FAQ but neither TFM nor google are being very helpful... > > I have a storage server with 12 SATA drives on an HBA. I want to backup > to those drives, using file volumes of 50GB or less. The idea is to > manually swap the drives as they get full. > > I'm looking for the implementation with least moving parts. From what I > see out there my choices are > > 1. Autochanger. > > Can I just omit the "Changer Command =" (or set it to /bin/true) and > it'll magically work? > > Or do I have to have a "fake autochanger" script -- and if I do, how is > it supposed to work with 12 drives all mounted at once? E.g. TFM has an > example of 2-drive configuration, but it doesn't say what "mtx-chager > loaded" is supposed to return in that case. > > 2. Give each client its own disk. I'll consider it if all else fails, > but obviously this is far from optmal. > > Any suggestions? Use the bacula vchanger to create a virtual disk autochanger. http://sourceforge.net/projects/vchanger/ Make each hard disk a virtual magazine with a set of fixed size volumes. John -- Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET Get 100% visibility into your production application - at no cost. Code-level diagnostics for performance bottlenecks with <2% overhead Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
On 05/02/2013 12:59 PM, John Drescher wrote: > Use the bacula vchanger to create a virtual disk autochanger. > > http://sourceforge.net/projects/vchanger/ > > Make each hard disk a virtual magazine with a set of fixed size volumes. Yes, I saw the wiki page, thanks. I can't help thinking there's gotta be a simpler way: can't bacula handle 2 tape drives at once? Or a DVD-burner tower? Or is the only way to use them is the moving symlink? -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with <2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
>> Use the bacula vchanger to create a virtual disk autochanger. >> >> http://sourceforge.net/projects/vchanger/ >> >> Make each hard disk a virtual magazine with a set of fixed size volumes. > > Yes, I saw the wiki page, thanks. I can't help thinking there's gotta be > a simpler way: vchanger is very simple to use. At home I set it up years ago and its pretty much set it and forget it. > can't bacula handle 2 tape drives at once? Or a > DVD-burner tower? Or is the only way to use them is the moving symlink? > DVDs are out, bacula has not supported them in years. Tape drives yes bacula will can use more than 1 tape drive just like it can use more than 1 disk storage device. A single job can never use more than device. Also with multiple independent storage devices you would have to manage and schedule your jobs to each device instead of sending all jobs to an autochanger resource and let bacula handle things. I done this both ways and I can say the virtual autochanger is considerably easier to use. John -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with <2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] multi-homed SD & single-homed FDs
I'm trying to setup a multi-homed DIR + SD to service two different VLANs that are firewalled from each other. I've tried configuring multiple Storage per Pool in bacula-dir.conf, each one with a different IP address (no hostnames; I don't manage DNS here), but the FD on the client for VLAN #2 still keeps trying to contact the SD on VLAN #1 and timing out. The old DNS-based routing hacks aren't feasible in my environment: I can only get one IP per hostname, and I do NOT want to manually edit /etc/hosts files (that's a maintenance nightmare). Is anyone else managing to do this successfully in Bacula (Community Edition 5.2.13), or do I have to do some routing magic on each host and a loopback IP on the SD? Thanks, -Adam Thompson University of Winnipeg Library Systems ad.thomp...@uwinnipeg.ca Cell: (204) 291-7950 -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with <2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
On 05/02/2013 2:44 pm, John Drescher wrote: > Use the bacula vchanger to create a virtual disk autochanger. > > http://sourceforge.net/projects/vchanger/ > > Make each hard disk a virtual magazine with a set of fixed size > volumes. > > Yes, I saw the wiki page, thanks. I can't help thinking there's gotta > be > a simpler way: > > vchanger is very simple to use. At home I set it up years ago and its > pretty much set it and forget it. > > can't bacula handle 2 tape drives at once? Or a > DVD-burner tower? Or is the only way to use them is the moving symlink? > > > DVDs are out, bacula has not supported them in years. Tape drives yes > bacula will can use more than 1 tape drive just like it can use more > than 1 disk storage device. A single job can never use more than > device. Also with multiple independent storage devices you would have > to manage and schedule your jobs to each device instead of sending all > jobs to an autochanger resource and let bacula handle things. I done > this both ways and I can say the virtual autochanger is considerably > easier to use. > > John > > -- > Get 100% visibility into Java/.NET code with AppDynamics Lite > It's a free troubleshooting tool designed for production > Get down to code-level detail for bottlenecks, with <2% overhead. > Download for free and get started troubleshooting in minutes. > http://p.sf.net/sfu/appdyn_d2d_ap2 > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users I personally thought vchanger was a little overcomplicated for my needs when I setup up my disk backups with a rotation on my home network. I am using GEOM ELI encryption on FreeBSD anyways for security so it requires manual work to mount the disk partition so I didn't care if I had an additional command to run. So Rather than going through the trouble of configuring vchanger. I just created a simple shell script to execute that just sends a series of commands to bconsole and sets the volume status to disabled for the offline volumes and sets the status to enabled for the online volumes. Its quick and simple, works great for me having a three hard disk rotation (19 Bacula volumes per hard disk), changed once a week. My original plan was to go back and learn vchanger later once I had everything else figured out, but this has worked out well enough that I never got around to it. This would get ugly in a hurry though if you were going to manage a large number of drives and volumes, and requires you to make sure you remember to run the command. Just thought I would throw the idea out there. -- Thanks, Dean E. Weimer http://www.dweimer.net/ -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with <2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] multi-homed SD & single-homed FDs
On Thu, May 02, 2013 at 02:21:15PM -0500, Adam Thompson wrote: > I'm trying to setup a multi-homed DIR + SD to service two different VLANs > that are firewalled from each other. They are not firewalled anymore if you add a dualhomed host. Why not backup from a third vlan that is firewalled against the other two to only accespt the neccessary backup traffic? Regards, Adrian -- LiHAS - Adrian Reyer - Hessenwiesenstraße 10 - D-70565 Stuttgart Fon: +49 (7 11) 78 28 50 90 - Fax: +49 (7 11) 78 28 50 91 Mail: li...@lihas.de - Web: http://lihas.de Linux, Netzwerke, Consulting & Support - USt-ID: DE 227 816 626 Stuttgart -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with <2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula and Glacier
The last time I asked about this there was skepticism about using Amazon Glacier for cloud storage of backups generated by Bacula. I still have some interest in this particularly for off site backups for disaster recovery at least for occasional snapshots. Has anyone actually had success using Glacier with Bacula? I have done some minimal tests using https://github.com/uskudnik/amazon-glacier-cmd-interface/blob/master/doc/Scripting.rst It's not very usable for daily backups as is. The backup volumes get appended to until they reach their maximum and would be sent repeatedly until they hit the max and a new volume is created. If I got around this by some how forcing a new volume each time it would result in small files being sent to Glacier, which is not desirable. I suppose I could decouple the Glacier send from the Bacula director and just send finished volumes when a cron sees that a new one has been created. At any rate, just wondering if anyone is using Bacula with Glacier and how. -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with <2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
On 05/02/2013 02:44 PM, John Drescher wrote: ... A single job can never use more than > device. No, but I don't have a single job. ;) ...Also with multiple independent storage devices you would have > to manage and schedule your jobs to each device instead of sending all > jobs to an autochanger resource and let bacula handle things. That's kinda what I meant "far from optimal", however, it looks like this lets me write to several disks in parallel. I might get a speed-up to offset the extra pain. -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with <2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup to multiple disks
> ...Also with multiple independent storage devices you would have >> to manage and schedule your jobs to each device instead of sending all >> jobs to an autochanger resource and let bacula handle things. > > That's kinda what I meant "far from optimal", however, it looks like > this lets me write to several disks in parallel. I might get a speed-up > to offset the extra pain. With vchanger you can also have multiple drives in a much more flexible way. You can add as many virtual drives as you want concurrency (this need not be how many hard drives you have connected) and all jobs will use the autochanger device instead of forcing individual devices. John -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with <2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
