Re: [Bacula-users] How to do Cross Replication Site1=Site2 (DR)
SITE 1 -- INTERNET - SITE2 Dir1.Dir2 (Catalog)(REPLICATED)(Catalog) SD1...(REPLICATED)..SD2 FD...FD FD...FD FD...FD The volumes can be easily replicated using any OS tool, that's OK. The problem is the DB (Catalog) since i understand that job ids may be duplicated in case i sync both sites databases. Bacula Copy Job with SelectionType=PoolUncopiedJobs would produce similar redundancy results (mirroring) with the proper database index you need in Bacula database. Regards, == Heitor Medrado de Faria - LPIC-III | ITIL-F 12 a 23 de janeiro de 2015 - Treinamento Telepresencial Bacula: http://www.bacula.com.br/?p=2174 61 2021-8260 | 8268-4220 Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: heitorfa...@gmail.com === - Mensagem original - De: Pr0sper0 bacula-fo...@backupcentral.com Para: bacula-users@lists.sourceforge.net Enviadas: Terça-feira, 25 de novembro de 2014 22:21:06 Assunto: [Bacula-users] How to do Cross Replication Site1=Site2 (DR) Hello All, After reading the official Bacula documentation i couldn't found a solution for my situation. I wonder if someone had the same issue. This is what i need to do in order to address Disaster Recovery: SITE 1 -- INTERNET - SITE2 Dir1.Dir2 (Catalog)(REPLICATED)(Catalog) SD1...(REPLICATED)..SD2 FD...FD FD...FD FD...FD The volumes can be easily replicated using any OS tool, that's OK. The problem is the DB (Catalog) since i understand that job ids may be duplicated in case i sync both sites databases. Is there any way to address this safely ? Thanks a lot for your response. Have an excelente day! :) +-- |This was sent by pr0sper0st...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Running bacula-fd as non-root
Thanks for your replies folks, I got it to work on CentOS for now using /etc/sysconfig/bacula-fd. All the best, Uwe -- NIONEX --- Ein Unternehmen der Bertelsmann SE Co. KGaA -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Possible bug/enhancement request regarding the Volume column in Status Director output
Bacula does not seem to be correctly determining the Volume column in the
stat dir output.
---[ tl;dr verson ]---
When considering volumes for the expected volume of an upcoming job, Bacula
appears to be ignoring the Job/JobDef options:
Full Backup Pool =
Incremental Backup Pool =
Differential Backup Pool =
And only considers volumes from the Pool = line in the Job/JobDefs.
---[Full Version]---
On the server in question I have about 20 jobs/night that run, and am using
Josh Fisher's vchanger program to write to (10) magazines (removable eSATA
Drives), each with (60) 10GB file volumes on them.
Currently, magazine 5 is connected, Bacula knows what slot each file volume is
in, and all volumes on this magazine are Enabled.
Below is a partial output of a current status dir command:
Scheduled Jobs:
Level TypePri Scheduled Job Name Volume
...snip...
IncrementalBackup 10 26-Nov-14 20:30 dns1 c0_0005_0067
IncrementalBackup 10 26-Nov-14 20:30 Helpdesk c0_0005_0067
IncrementalBackup 10 26-Nov-14 20:30 Voip c0_0005_0067
Full Backup 20 27-Nov-14 02:45 Catalog c0_0005_0067
Most Jobs are set to run Full on the first Saturday of the month, Differential
on every other Saturday, and Incremental Sunday-Friday.
I have one JobDefs resource, called Defaults, which is used by all Jobs,
with some minor, per-job overrides for Fileset names, Schedules, RunScripts,
etc.
In my Defaults Jobdef I have defined the Pool(s) for the Job using the
following:
JobDefs {
Name = Defaults
Level = Incremental
Storage = c0
Messages = Standard
Pool = Offsite-eSATA-Full
Full Backup Pool = Offsite-eSATA-Full
Incremental Backup Pool = Offsite-eSATA-Inc
Differential Backup Pool = Offsite-eSATA-Diff
...snip...
}
Volume c0_0005_0067 in currently in the Offsite-eSATA-Full pool, with a status
of Append and was the last volume used by last night's Full Catalog job...
Bacula knows that the first few jobs listed above are scheduled to be
Incremental, however, Bacula appears to be using the line:
Pool = Offsite-eSATA-Full
from the JobDefs, and ignoring the fact that there are specific Pool
definitions for Full, Incremental, and Differential backups.
When I change the Pool = line to Pool = Offsite-eSATA-Diff (or Inc),
issue a reload and then status dir in bconsole, Bacula shows that the expected
volume for those Incremental jobs will be an appendable volume in whatever I
set the Pool = line to.
Thanks for any thoughts on this.
Bill
--
Bill Arlofski
Reverse Polarity, LLC
http://www.revpol.com/
-- Not responsible for anything below this line --
--
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Enable LTO-4 Hardware compression on bacula.
Hi, first of all i'm sorry for my english. I post here because i'm not able to enable Hardware compression on my LTO-4 tape. I was reading a lot of forums with info about how to enable, but tape still without compression. My tape drive is a [url=http://www.quantum.com/serviceandsupport/softwareanddocumentationdownloads/lto-4hh/index.aspx]Quantum Ultrium LTO-4 HH Original[/ur] and is able to HW compress data. Here's the report of some utilities: tapeinfo -f /dev/st0 Product Type: Tape Drive Vendor ID: 'QUANTUM ' Product ID: 'ULTRIUM 4 ' Revision: '2170' Attached Changer API: No SerialNumber: 'PW0752AMJ50072' MinBlock: 1 MaxBlock: 16777215 SCSI ID: 4 SCSI LUN: 0 Ready: yes BufferedMode: yes Medium Type: Not Loaded Density Code: 0x46 BlockSize: 0 DataCompEnabled: yes DataCompCapable: yes DataDeCompEnabled: yes CompType: 0x1 DeCompType: 0x1 Block Position: 0 Partition 0 Remaining Kbytes: 0 Partition 0 Size in Kbytes: 852950 ActivePartition: 0 EarlyWarningSize: 0 - - tapeinfo -f /dev/nst0 Product Type: Tape Drive Vendor ID: 'QUANTUM ' Product ID: 'ULTRIUM 4 ' Revision: '2170' Attached Changer API: No SerialNumber: 'PW0752AMJ50072' MinBlock: 1 MaxBlock: 16777215 SCSI ID: 4 SCSI LUN: 0 Ready: yes BufferedMode: yes Medium Type: Not Loaded Density Code: 0x46 BlockSize: 0 DataCompEnabled: yes DataCompCapable: yes DataDeCompEnabled: yes CompType: 0x1 DeCompType: 0x1 BOP: yes Block Position: 0 Partition 0 Remaining Kbytes: 0 Partition 0 Size in Kbytes: 852950 ActivePartition: 0 EarlyWarningSize: 0 - - cat /sys/class/scsi_tape/st0/default_compression 1 - - cat /sys/class/scsi_tape/nst0/default_compression 1 - - It looks activated but i'm not able to use it... bacula still using only 800GB of tape. I know that it depends of compression ratio of stored files, but if gzip gets about 26% of CR, HW must get at least 10% of CR... PDTA: All compressions in bacula are disabled Thanks!! +-- |This was sent by danielmadri...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to do Cross Replication Site1=Site2 (DR)
Interesting problem. If we were just talking MySQL replication, there is a setting increment where you would set it to 2 in this case and no duplicate record numbers would be generated. In this case we need an increment setting for bacula jobids, or perhaps a number of sites or sites setting, which would accomplish the same thing so non-duplicating jobids would be generated within bacula. -Original Message- From: Heitor Faria [mailto:hei...@bacula.com.br] Sent: Wednesday, November 26, 2014 7:00 AM To: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] How to do Cross Replication Site1=Site2 (DR) SITE 1 -- INTERNET - SITE2 Dir1.Dir2 (Catalog)(REPLICATED)(Catalog) SD1...(REPLICATED)..SD2 FD...FD FD...FD FD...FD The volumes can be easily replicated using any OS tool, that's OK. The problem is the DB (Catalog) since i understand that job ids may be duplicated in case i sync both sites databases. Bacula Copy Job with SelectionType=PoolUncopiedJobs would produce similar redundancy results (mirroring) with the proper database index you need in Bacula database. Regards, == Heitor Medrado de Faria - LPIC-III | ITIL-F 12 a 23 de janeiro de 2015 - Treinamento Telepresencial Bacula: http://www.bacula.com.br/?p=2174 61 2021-8260 | 8268-4220 Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: heitorfa...@gmail.com === - Mensagem original - De: Pr0sper0 bacula-fo...@backupcentral.com Para: bacula-users@lists.sourceforge.net Enviadas: Terça-feira, 25 de novembro de 2014 22:21:06 Assunto: [Bacula-users] How to do Cross Replication Site1=Site2 (DR) Hello All, After reading the official Bacula documentation i couldn't found a solution for my situation. I wonder if someone had the same issue. This is what i need to do in order to address Disaster Recovery: SITE 1 -- INTERNET - SITE2 Dir1.Dir2 (Catalog)(REPLICATED)(Catalog) SD1...(REPLICATED)..SD2 FD...FD FD...FD FD...FD The volumes can be easily replicated using any OS tool, that's OK. The problem is the DB (Catalog) since i understand that job ids may be duplicated in case i sync both sites databases. Is there any way to address this safely ? Thanks a lot for your response. Have an excelente day! :) +-- |This was sent by pr0sper0st...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk
Re: [Bacula-users] How to make bacula handle sparse files correctly
Look good, but I think you should remove
File = /opt/virtual/images
from the Exclude clause.
__Martin
On Tue, 25 Nov 2014 18:35:27 +, Polcari, Joe (Contractor) said:
So I can't quite grasp this.
I have a directory which is part of / that contains virtual disk images,
/opt/virtual/images.
I think I want to set that directory to do sparse files since I don't
allocate the complete disk when I create a VM.
So I start with:
FileSet {
Name = puppetmaster-fileset
Include {
Options {
signature = MD5
noatime = yes
}
File = /boot
File = /
File = /var/lib/mysql
}
Exclude {
File = /var/spool/bacula
File = /tmp
File = /proc
File = /tmp
File = /.journal
File = /.fsck
}
}
I should change it to:
FileSet {
Name = puppetmaster-fileset
Include {
Options {
signature = MD5
noatime = yes
}
File = /boot
File = /
File = /var/lib/mysql
}
Exclude {
File = /opt/virtual/images
File = /var/spool/bacula
File = /tmp
File = /proc
File = /tmp
File = /.journal
File = /.fsck
}
Include {
Options {
signature = MD5
noatime = yes
sparse = yes
}
File = /opt/virtual/images
}
Is that right?
-Original Message-
From: Bill Arlofski [mailto:waa-bac...@revpol.com]
Sent: Monday, November 24, 2014 5:24 PM
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] How to make bacula handle sparse files correctly
On 11/24/2014 12:14 PM, Polcari, Joe (Contractor) wrote:
I added an instance of docker to one of my systems. This added a sparse
file of 10 GB with a real size of 100 GB.
This should have only added 10GB to my full backup but it added 100GB.
Is there any way to tell bacula to handle sparse files correctly?
Hi Joe,
There is an option for the Include stanza of a Fileset:
sparse = yes
Which works correctly with sparse files. We had to add this option to one of
our filesets when a newer version of of our mail server changed one of its db
files to sparse file.
If so, why isn't this the default? Shouldn't it be?
Not sure. Unless the code that deals with sparse files adds additional
overhead when it is typically not required.
With our setup, I have _one_ file that is sparse so it is excluded using the
wild = option in the bigger Include stanza of a Fileset, then Included
specifically in a File = option in the second Include stanza which has the
sparse = yes option.
Maybe someone else can comment re: default being sparse = no
Hope this helps.
Bill
--
Bill Arlofski
Reverse Polarity, LLC
http://www.revpol.com/
-- Not responsible for anything below this line --
--
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
--
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Enable LTO-4 Hardware compression on bacula.
Remember that
you will get very little compression a second time. Have you tried
more than 1 tape? I assume you do not have any fixed volume size limit
set on the pool.
Thanks John for reply.
|| Is your data already compressed?
No, i've disabled gzip compression on bacula to speed up backups (from 10MB/s
to 50MB/s), and the most of files are uncompressed (pdf, doc, dwg...).
|| Have you tried more than 1 tape?
Yes, i've tried three. All formatted (one with mt command, and two with btape).
|| I assume you do not have any fixed volume size limit set on the pool.
I don't have any entry in pool about size limit or similar:
Pool {
Name = zurbano_servers_cinta_sys.po
Pool Type = Backup
Storage = triky_cinta_sys.st
LabelFormat = zurbano_servers-
Recycle = yes
AutoPrune = yes
Volume Retention = 2 months
Volume Use Duration = 1 months
Recycle Oldest Volume = yes
File Retention = 2 months
}
-
-
Storage {
Name = triky_cinta_sys.st
Address = 1xx.xx.xx.xx
SDPort = 9103
Password = passwd
Device = triky_cinta.de
Media Type = LTO-4
}
Device {
Name = triky_cinta.de
Media Type = LTO-4
Archive Device = /dev/st0
AutomaticMount = yes;
LabelMedia = yes
AlwaysOpen = yes;
RemovableMedia = yes;
RandomAccess = no;
Spool Directory = /server/bacula/spool
Maximum Spool Size = 1500g
Maximum Job Spool Size = 500g
Maximum File Size = 5g
}
-
-
Greetings!!
+--
|This was sent by danielmadri...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--
--
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] How to do Cross Replication Site1=Site2 (DR)
What about mysql cluster? http://dev.mysql.com/doc/refman/5.0/en/mysql-cluster-nodes-groups.html http://dev.mysql.com/doc/refman/5.1/en/mysql-cluster-online-add-node.html I've never tried this before, but maybe is a good solution ;) greetings!! Interesting problem. If we were just talking MySQL replication, there is a setting increment where you would set it to 2 in this case and no duplicate record numbers would be generated. In this case we need an increment setting for bacula jobids, or perhaps a number of sites or sites setting, which would accomplish the same thing so non-duplicating jobids would be generated within bacula. -Original Message- From: Heitor Faria [mailto:heitor at bacula.com.br] Sent: Wednesday, November 26, 2014 7:00 AM To: bacula-users at lists.sourceforge.net Subject: Re: [Bacula-users] How to do Cross Replication Site1=Site2 (DR) SITE 1 -- INTERNET - SITE2 Dir1.Dir2 (Catalog)(REPLICATED)(Catalog) SD1...(REPLICATED)..SD2 FD...FD FD...FD FD...FD The volumes can be easily replicated using any OS tool, that's OK. The problem is the DB (Catalog) since i understand that job ids may be duplicated in case i sync both sites databases. Bacula Copy Job with SelectionType=PoolUncopiedJobs would produce similar redundancy results (mirroring) with the proper database index you need in Bacula database. Regards, == Heitor Medrado de Faria - LPIC-III | ITIL-F 12 a 23 de janeiro de 2015 - Treinamento Telepresencial Bacula: http://www.bacula.com.br/?p=2174 61 2021-8260 | 8268-4220 Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: heitorfaria at gmail.com === - Mensagem original - De: Pr0sper0 bacula-forum at backupcentral.com Para: bacula-users at lists.sourceforge.net Enviadas: Terça-feira, 25 de novembro de 2014 22:21:06 Assunto: [Bacula-users] How to do Cross Replication Site1=Site2 (DR) Hello All, After reading the official Bacula documentation i couldn't found a solution for my situation. I wonder if someone had the same issue. This is what i need to do in order to address Disaster Recovery: SITE 1 -- INTERNET - SITE2 Dir1.Dir2 (Catalog)(REPLICATED)(Catalog) SD1...(REPLICATED)..SD2 FD...FD FD...FD FD...FD The volumes can be easily replicated using any OS tool, that's OK. The problem is the DB (Catalog) since i understand that job ids may be duplicated in case i sync both sites databases. Is there any way to address this safely ? Thanks a lot for your response. Have an excelente day! Smile +-- |This was sent by danielmadri...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to do Cross Replication Site1=Site2 (DR)
Won't work. The problem is not mysql replication, although if mysql is the DB, then it does need to be used. The problem is bacula JobIDs as well. -Original Message- From: Danixu86 [mailto:bacula-fo...@backupcentral.com] Sent: Wednesday, November 26, 2014 11:18 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] How to do Cross Replication Site1=Site2 (DR) What about mysql cluster? http://dev.mysql.com/doc/refman/5.0/en/mysql-cluster-nodes-groups.html http://dev.mysql.com/doc/refman/5.1/en/mysql-cluster-online-add-node.html I've never tried this before, but maybe is a good solution ;) greetings!! Interesting problem. If we were just talking MySQL replication, there is a setting increment where you would set it to 2 in this case and no duplicate record numbers would be generated. In this case we need an increment setting for bacula jobids, or perhaps a number of sites or sites setting, which would accomplish the same thing so non-duplicating jobids would be generated within bacula. -Original Message- From: Heitor Faria [mailto:heitor at bacula.com.br] Sent: Wednesday, November 26, 2014 7:00 AM To: bacula-users at lists.sourceforge.net Subject: Re: [Bacula-users] How to do Cross Replication Site1=Site2 (DR) SITE 1 -- INTERNET - SITE2 Dir1.Dir2 (Catalog)(REPLICATED)(Catalog) SD1...(REPLICATED)..SD2 FD...FD FD...FD FD...FD The volumes can be easily replicated using any OS tool, that's OK. The problem is the DB (Catalog) since i understand that job ids may be duplicated in case i sync both sites databases. Bacula Copy Job with SelectionType=PoolUncopiedJobs would produce similar redundancy results (mirroring) with the proper database index you need in Bacula database. Regards, == Heitor Medrado de Faria - LPIC-III | ITIL-F 12 a 23 de janeiro de 2015 - Treinamento Telepresencial Bacula: http://www.bacula.com.br/?p=2174 61 2021-8260 | 8268-4220 Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: heitorfaria at gmail.com === - Mensagem original - De: Pr0sper0 bacula-forum at backupcentral.com Para: bacula-users at lists.sourceforge.net Enviadas: Terça-feira, 25 de novembro de 2014 22:21:06 Assunto: [Bacula-users] How to do Cross Replication Site1=Site2 (DR) Hello All, After reading the official Bacula documentation i couldn't found a solution for my situation. I wonder if someone had the same issue. This is what i need to do in order to address Disaster Recovery: SITE 1 -- INTERNET - SITE2 Dir1.Dir2 (Catalog)(REPLICATED)(Catalog) SD1...(REPLICATED)..SD2 FD...FD FD...FD FD...FD The volumes can be easily replicated using any OS tool, that's OK. The problem is the DB (Catalog) since i understand that job ids may be duplicated in case i sync both sites databases. Is there any way to address this safely ? Thanks a lot for your response. Have an excelente day! Smile +-- |This was sent by danielmadri...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to do Cross Replication Site1=Site2 (DR)
Mysql replication may in fact guard against duplicate jobids, since the same jobids will be in both databases, in theory. It's the replication lag that will be the problem. During the lag it will still be possible to create duplicate bacula jobids. -Original Message- From: Danixu86 [mailto:bacula-fo...@backupcentral.com] Sent: Wednesday, November 26, 2014 11:18 AM To: bacula-users@lists.sourceforge.net Subject: [Bacula-users] How to do Cross Replication Site1=Site2 (DR) What about mysql cluster? http://dev.mysql.com/doc/refman/5.0/en/mysql-cluster-nodes-groups.html http://dev.mysql.com/doc/refman/5.1/en/mysql-cluster-online-add-node.html I've never tried this before, but maybe is a good solution ;) greetings!! Interesting problem. If we were just talking MySQL replication, there is a setting increment where you would set it to 2 in this case and no duplicate record numbers would be generated. In this case we need an increment setting for bacula jobids, or perhaps a number of sites or sites setting, which would accomplish the same thing so non-duplicating jobids would be generated within bacula. -Original Message- From: Heitor Faria [mailto:heitor at bacula.com.br] Sent: Wednesday, November 26, 2014 7:00 AM To: bacula-users at lists.sourceforge.net Subject: Re: [Bacula-users] How to do Cross Replication Site1=Site2 (DR) SITE 1 -- INTERNET - SITE2 Dir1.Dir2 (Catalog)(REPLICATED)(Catalog) SD1...(REPLICATED)..SD2 FD...FD FD...FD FD...FD The volumes can be easily replicated using any OS tool, that's OK. The problem is the DB (Catalog) since i understand that job ids may be duplicated in case i sync both sites databases. Bacula Copy Job with SelectionType=PoolUncopiedJobs would produce similar redundancy results (mirroring) with the proper database index you need in Bacula database. Regards, == Heitor Medrado de Faria - LPIC-III | ITIL-F 12 a 23 de janeiro de 2015 - Treinamento Telepresencial Bacula: http://www.bacula.com.br/?p=2174 61 2021-8260 | 8268-4220 Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: heitorfaria at gmail.com === - Mensagem original - De: Pr0sper0 bacula-forum at backupcentral.com Para: bacula-users at lists.sourceforge.net Enviadas: Terça-feira, 25 de novembro de 2014 22:21:06 Assunto: [Bacula-users] How to do Cross Replication Site1=Site2 (DR) Hello All, After reading the official Bacula documentation i couldn't found a solution for my situation. I wonder if someone had the same issue. This is what i need to do in order to address Disaster Recovery: SITE 1 -- INTERNET - SITE2 Dir1.Dir2 (Catalog)(REPLICATED)(Catalog) SD1...(REPLICATED)..SD2 FD...FD FD...FD FD...FD The volumes can be easily replicated using any OS tool, that's OK. The problem is the DB (Catalog) since i understand that job ids may be duplicated in case i sync both sites databases. Is there any way to address this safely ? Thanks a lot for your response. Have an excelente day! Smile +-- |This was sent by danielmadri...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] How to do Cross Replication Site1=Site2 (DR)
But you're using both directors to make backups, or the second is only a mirror waiting for dissaster?, because for example, i've an script running every day to dump the entire database to another server, then if there are any dissasters, i only have to import the last backup to a new director. Maybe is different, because my director is in a Virtual Machine, and i've a backup of that machine in another server, then if something fails, i only have to power on that backup of director and import the last database. Greetings!! -Original Message- Mysql replication may in fact guard against duplicate jobids, since the same jobids will be in both databases, in theory. It's the replication lag that will be the problem. During the lag it will still be possible to create duplicate bacula jobids. +-- |This was sent by danielmadri...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] How to do Cross Replication Site1=Site2 (DR)
Guys, First let me thank you all for your responses, i really appreciate them. As Joe, i think the problem here are the bacula jobids, ¿ is there any way to say bacula to start from (let say) job id 900 ? i think that's an easy way to fix all the problem as i will be able to replicate both databases and have (and this is what is most important) a concistent way to restore site1 FROM site2 or viceversa. Answering Danixu86's question, Yes , both directors will do their respective backups on their respective storages in order to let all the FDs in SITE2 to backup through the LAN to SD2 and same situation in SITE1 (to not pass anything through internet)... I may be commiting a mistake here, probably a missunderstanding, please let me know if i'm saying something stupid on this last one . [Rolling Eyes] :D . Thanks again for sharing your thoughts ! +-- |This was sent by pr0sper0st...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to do Cross Replication Site1=Site2 (DR)
Good afternoon, Will a standard replication work for this purpose?. I explain, this way of course you will be able to have a replicated database state. But what you really need isn't the snapshot of both members, database and storage daemon at the same moment in a concrete instant ?. Imagine you have a database server and a dir-sd different server connected to a disk array for example. Imagine that dir-sd machine goes down while Mysql is running a huge query for entering something in database. That query finishes fine and the info is replicated, but the sd-dir has gone down 20 minutes ago!! Would be ok really, just to have replicated that way?. You will have database fine, but perhaps the disk (virtual types) from file storage are not the way “the well database describes”. Would really this would be valid as HA? Best regards, El 26/11/2014, a las 17:50, Danixu86 bacula-fo...@backupcentral.com escribió: But you're using both directors to make backups, or the second is only a mirror waiting for dissaster?, because for example, i've an script running every day to dump the entire database to another server, then if there are any dissasters, i only have to import the last backup to a new director. Maybe is different, because my director is in a Virtual Machine, and i've a backup of that machine in another server, then if something fails, i only have to power on that backup of director and import the last database. Greetings!! -Original Message- Mysql replication may in fact guard against duplicate jobids, since the same jobids will be in both databases, in theory. It's the replication lag that will be the problem. During the lag it will still be possible to create duplicate bacula jobids. +-- |This was sent by danielmadri...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Possible bug/enhancement request regarding the Volume column in Status Director output
On 11/26/2014 08:39 AM, Bill Arlofski wrote: ---[ tl;dr verson ]--- When considering volumes for the expected volume of an upcoming job, Bacula appears to be ignoring the Job/JobDef options: Full Backup Pool = Incremental Backup Pool = Differential Backup Pool = And only considers volumes from the Pool = line in the Job/JobDefs. No help here but I had it go (using your naming) from c0_0005_0067 to c0_0006_0067 instead of c0_0005_0068 after a problem of some kind (I forget what, exactly). That was with only one pool, so I wonder if the problem is in the JobDefs. My impression is bacula's algorithm for choosing next volume is fcsked up beyond understanding. -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] How to do Cross Replication Site1=Site2 (DR)
I see your point Egoltz, no matter what i think, all the options in my mind
always reach a dead end. The only option i'm thinking now is to have
Active/Inactive Director (like failover) through internet, that way i'll have
all the catalog issue solved, then i can replicate the volumes like normal
files using OS tools. The only question that i have with this solution is:
Example:
Site1
Dir 1: 192.168.1.1 (ACTIVE)
SD 1: 192.168.1.2
FD 1: 192.168.1.3
|
|
INTERNET
|
|
Site2
Dir 2: 192.168.2.1 (inactive)
SD 2: 192.168.2.2
FD 2: 192.168.2.3
I say to FD1 to backup on SD1, that's perfectly fine since is LAN, but then i
say FD2 to backup on SD2 now how to configure the SD2 on DIR1 in order to
disallow the backup to pass through the internet.
I'm imaging this configuration:
Dir 1
Storage {
Name = SD1
Address = 192.168.1.2
}
Storage {
Name = SD2
Address = 192.168.2.2
}
is this config ok on Site 1 - Dir 1 ??
Sorry i'm :S right now heehhe.
+--
|This was sent by pr0sper0st...@gmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--
--
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to make bacula handle sparse files correctly
On 11/26/2014 10:36 AM, Martin Simmons wrote: Look good, but I think you should remove File = /opt/virtual/images from the Exclude clause. __Martin Hi Martin, if that is removed, then the sparse file will be backed up twice. Once without the benefit of Bacula's sparse file support as part of the File = / in the first Include stanza - and it would be a full 40GB, then a second time with Bacula's sparse file support as part of the second Include Stanza. The Exclude makes sure Bacula skips it when sparse file support is not enabled. Bill -- Bill Arlofski Reverse Polarity, LLC http://www.revpol.com/ -- Not responsible for anything below this line -- -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to do Cross Replication Site1=Site2 (DR)
First let me thank you all for your responses, i really appreciate them. As Joe, i think the problem here are the bacula jobids, ¿ is there any way to say bacula to start from (let say) job id 900 ? i think that's an easy way to fix all the problem as i will be able I am not familiar enough with mysql and it's workings but with postgres, the jobid column in the job table is defined as a sequence - job_jobid_seq. When this is first created it can be seeded with whatever starting value that you wish. e.g. \d job_jobid_seq Sequence public.job_jobid_seq Column | Type |Value ---+-+- sequence_name | name| job_jobid_seq last_value| bigint | 328864 start_value | bigint | 1 increment_by | bigint | 1 max_value | bigint | 9223372036854775807 min_value | bigint | 1 cache_value | bigint | 1 log_cnt | bigint | 31 is_cycled | boolean | f is_called | boolean | t So, you could have one server start at 1 and another start at some number that you know the first server will never reach (assuming you want them to have unique job id sets forever). hope this helps, --tom -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How to do Cross Replication Site1=Site2 (DR)
On 11/26/2014 03:07 PM, Thomas Lohman wrote: First let me thank you all for your responses, i really appreciate them. As Joe, i think the problem here are the bacula jobids, ¿ is there any way to say bacula to start from (let say) job id 900 ? i think that's an easy way to fix all the problem as i will be able I am not familiar enough with mysql and it's workings but with postgres, the jobid column in the job table is defined as a sequence - job_jobid_seq. When this is first created it can be seeded with whatever starting value that you wish. There is of course the right way to do this: Return-Path: k...@sibbald.com Message-ID: 518ddbc1.3020...@sibbald.com Date: Sat, 11 May 2013 07:48:49 +0200 From: Kern Sibbald k...@sibbald.com To: Dimitri Maziuk dmaz...@bmrb.wisc.edu CC: bacula-users@lists.sourceforge.net bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] RAIT anyone? ... Hello, As James points out a RAID 1 (mirror) is not in our plans. However, making two copies of the same backup on two different Devices is something that is very likely to happen before the end of the year. The first cut will be to write to two or more devices in the same SD. The second cut will be to write to more than 1 SD. Regards, Kern The functionality has very likely happened before the end of 2013, all you need to do is have another SD at Site2, /troll -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] How to do Cross Replication Site1=Site2 (DR)
|| Answering Danixu86's question, Yes , both directors will do their respective backups on their respective storages in order to let all the FDs in SITE2 to backup through the LAN to SD2 and same situation in SITE1 (to not pass anything through internet)... I may be commiting a mistake here, probably a missunderstanding, please let me know if i'm saying something stupid on this last one . I forgot one thing that maybe is the best solution: Why don't use different catalogs?, you can have two catalogs in same mysql database, then don't cares what job number and you can syncro both databases without any duplicated job. For example: MySql1 Internet---MySql2 Cat1 (U) --- Cat1 (B) Cat2 (B) --- Cat2 (U) Dir1 --- Dir2 Sd1 - Sd2 Dir1 - Cat1 Dir2 - Cat2 (U) = Using (B) = Backup Then, in first director, you can use the Cat1 as catalog with it's own job number, and in second director, you can use the Cat2 as catalog with it's own job number. Then you can syncro both MySql every day or whatever you want, and don't cares if other catalog has a Job with same ID. Greetings!! +-- |This was sent by danielmadri...@gmail.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
