Re: [Bacula-users] [Bacula-devel] Bacula Status + Bacula 5.2.0 release
On Sun, Oct 30, 2011 at 4:14 PM, Phil Stracchino wrote: > On 10/30/11 12:59, John Drescher wrote: >> On Thu, Oct 27, 2011 at 4:07 PM, Phil Stracchino >> wrote: >>> I just compared what the script was doing to the existing schema and >>> made the necessary changes by hand. Wasn't a problem, and nothing >>> non-obvious showed up. >>> >> >> So you did not make an update script (from 13 to 14) in the process? >> Just checking before I spend time creating this myself. I tried to >> update to 5.2.1 on my test box (home network - not work) but got >> greeted with the incompatible schema and the update script would not >> work since I have schema 13 not 12. > > No, I admit I didn't because I only expected to do it once and didn't > figure many other people were going to need to. > > I think there were only about three changes. > Thanks. I will have to check more closely then as I only upped the schema version.. John -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Bacula Status + Bacula 5.2.0 release
On 10/30/11 12:59, John Drescher wrote: > On Thu, Oct 27, 2011 at 4:07 PM, Phil Stracchino wrote: >> I just compared what the script was doing to the existing schema and >> made the necessary changes by hand. Wasn't a problem, and nothing >> non-obvious showed up. >> > > So you did not make an update script (from 13 to 14) in the process? > Just checking before I spend time creating this myself. I tried to > update to 5.2.1 on my test box (home network - not work) but got > greeted with the incompatible schema and the update script would not > work since I have schema 13 not 12. No, I admit I didn't because I only expected to do it once and didn't figure many other people were going to need to. I think there were only about three changes. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula-Web documentation URL
Hello Geert, You're right, please see the right documentation's link below http://bacula-web.dflc.ch/index.php/docs.html Thanks for your feedback. Regards Davide Op 20111024 om 13:04 schreef bacula-...@dflc.ch: > > Dear all, > > > > I'm proud to announce you that from now, you're able to subscribe to the > > Bacula-Web's newsletter. > > > > The online subscription form is available through the link below > > > > Newsletter subscription form > > > > As usual, any feedback is welcome > > > > > > > > Best regards > > > > Davide > > > > Bacula-Web project site: http://bacula-web.dflc.ch > > Documentation: http://bacula-web.dflc.ch/docs > > That URL yields a 'not found' > > At Bacula-Web project site http://bacula-web.dflc.ch/ > is a link that points back to http://bacula-web.dflc.ch/ > > > Hope this helps > > Cheers > Geert Stappers > -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HW crypto offload
The quickest way to find out is to configure a backup without crypto and see
how long it takes. You could also do another test with GZIP compression on/off.
---Guy
(via iPhone)
On 30 Oct 2011, at 16:23, Alex Crow wrote:
>
>>> If it is supported in any way, I'd be happy to know. If not, what would
>>> be the best way about getting it implemented?
>> I'd want to be pretty sure its going to help before doing this. On my
>> (somewhat aged) development machine, OpenSSL can do AES-128 CBC at 55
>> MB/s (bytes, not bits), so it doesn;t sound like crypto is necessarily
>> your bottleneck.
>>
>> Also, crypto "accelerators" rarely do in my experience.
>>
>
> Ben,
>
> CPU is:
>
> model name : Intel(R) Xeon(R) CPU E5540 @ 2.53GHz
>
> We run 4 backup threads and get 4 cores doing 100% each, still we're
> only getting the 80 Megabits.
>
> Here's the part of the bacula-fd.conf that is relevant:
>
> FileDaemon {
> Name = backup-fd
> FDport = 9102
> WorkingDirectory = /var/lib/bacula
> Pid Directory = /var/run
> Maximum Concurrent Jobs = 20
> FDAddress = 127.0.0.1
>
> PKI Signatures = Yes
> PKI Encryption = Yes
> PKI Keypair = "/etc/bacula/keys/bacula-fd.pem"
> PKI Master Key = "/etc/bacula/keys/master.cert"
> }
>
> Here's an example job spec:
>
> Job {
> Name = "ias"
> JobDefs = "Standard"
> Schedule = "With-Basejobs"
> FileSet = "ias"
> Accurate = yes
> Base = "ias-base"
> }
>
> Job {
> Name = "ias-base"
> Level = Base
> JobDefs = "Standard"
> FileSet = "ias"
> Schedule = "Update-Basejobs"
> Accurate = yes
> }
>
> FileSet {
> Name = "ias"
> Include {
> Options {
> BaseJob = pmugcs5
> Accurate = mcs5
> Verify = pin5
> signature = MD5
> compression=GZIP
> }
> File = /nas/ias
> }
> Exclude {
> File = /nas/exclude
> }
> }
>
> Storage def from bacula-dir.conf:
>
> Storage {
> Name = Tandberg
> Address = 127.0.0.1
> SDPort = 9103
> Password = "e3Ci8AxSF2ewxzX2VgaU"
> Device = Tandberg
> Autochanger = yes
> Media Type = LTO3
> Maximum Concurrent Jobs = 20
> AllowCompression = yes
> }
>
> Devices in bacula-sd.conf:
>
> Autochanger {
> Name = Tandberg
> Device = IBM0, IBM1
> Changer Device = /dev/sg6
> Changer Command = "/usr/lib64/bacula/mtx-changer %c %o %S %a %d"
> }
>
> Device {
> Name = IBM0
> Drive Index = 0
> Media Type = LTO3
> Archive Device = /dev/st0
> AutomaticMount = yes;
> AlwaysOpen = yes;
> RemovableMedia = yes;
> RandomAccess = no;
> Autochanger = yes;
> Maximum Concurrent Jobs = 2
> Spool Directory = "/opt/spool/ibm0"
> }
>
> Device {
> Name = IBM1
> Drive Index = 1
> Media Type = LTO3
> Archive Device = /dev/st1
> AutomaticMount = yes;
> AlwaysOpen = yes;
> RemovableMedia = yes;
> RandomAccess = no;
> Autochanger = yes;
> Maximum Concurrent Jobs = 2
> Spool Directory = "/opt/spool/ibm1"
> }
>
> Could it be the "compression=GZIP" in the job defs that is slowing
> things down?
>
> I really should get my colleague to join this as he's the one that set
> this up.
>
> Cheers
>
> Alex
>
>
>
>
> --
> This message is intended only for the addressee and may contain
> confidential information. Unless you are that person, you may not
> disclose its contents or use it in any way and are requested to delete
> the message along with any attachments and notify us immediately.
>
> "Transact" is operated by Integrated Financial Arrangements plc
> Domain House, 5-7 Singer Street, London EC2A 4BQ
> Tel: (020) 7608 4900 Fax: (020) 7608 5300
> (Registered office: as above; Registered in England and Wales under number:
> 3727592)
> Authorised and regulated by the Financial Services Authority (entered on the
> FSA Register; number: 190856)
>
>
> --
> Get your Android app more play: Bring it to the BlackBerry PlayBook
> in minutes. BlackBerry App World™ now supports Android™ Apps
> for the BlackBerry® PlayBook™. Discover just how easy and simple
> it is! http://p.sf.net/sfu/android-dev2dev
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
smime.p7s
Description: S/MIME cryptographic signature
--
Get your Android app more play: Bring it to the BlackBerry PlayBook
in minutes. BlackBerry App World™ now supports Android™ Apps
for the BlackBerry® PlayBook™. Discover just how easy and simple
it is! http://p.sf.net/sfu/android-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge
Re: [Bacula-users] [Bacula-devel] Bacula Status + Bacula 5.2.0 release
On Thu, Oct 27, 2011 at 4:07 PM, Phil Stracchino wrote: > On 10/27/11 15:44, Kern Sibbald wrote: >>> Looks like the DB upgrade scripts for 5.2.0 can upgrade the DB from >>> v5.0, but not from v5.1. I have a v13 database. I'm patching the DB >>> manually right now, but this may leave people who've been experimenting >>> with 5.1 stranded. >>> >>> Anything I need to watch out for here...? > >> I recommend diffing the make_xxx_tables.in script you have for the 5.1 >> that you used >> to the current 5.2.0 script. That should tell you pretty clearly what >> you need to do. > > I just compared what the script was doing to the existing schema and > made the necessary changes by hand. Wasn't a problem, and nothing > non-obvious showed up. > So you did not make an update script (from 13 to 14) in the process? Just checking before I spend time creating this myself. I tried to update to 5.2.1 on my test box (home network - not work) but got greeted with the incompatible schema and the update script would not work since I have schema 13 not 12. John -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Version 5.2.1 released
On Sun, 2011-10-30 at 15:35 +0100, Kern Sibbald wrote: > Hello, > > Today, we released Bacula version 5.2.1. If you downloaded version > 5.2.0, sorry for the inconvenience, but I *strongly recommend you > download version 5.2.1 to avoid possible problems. > indeed -- fantastic news :-) can wait for the rpms :-) bacula is marvelous. m -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HW crypto offload
> Could it be the "compression=GZIP" in the job defs that is slowing > things down? > Yes. Try disabling that. > I really should get my colleague to join this as he's the one that set > this up. > John -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HW crypto offload
>> If it is supported in any way, I'd be happy to know. If not, what would
>> be the best way about getting it implemented?
> I'd want to be pretty sure its going to help before doing this. On my
> (somewhat aged) development machine, OpenSSL can do AES-128 CBC at 55
> MB/s (bytes, not bits), so it doesn;t sound like crypto is necessarily
> your bottleneck.
>
> Also, crypto "accelerators" rarely do in my experience.
>
Ben,
CPU is:
model name : Intel(R) Xeon(R) CPU E5540 @ 2.53GHz
We run 4 backup threads and get 4 cores doing 100% each, still we're
only getting the 80 Megabits.
Here's the part of the bacula-fd.conf that is relevant:
FileDaemon {
Name = backup-fd
FDport = 9102
WorkingDirectory = /var/lib/bacula
Pid Directory = /var/run
Maximum Concurrent Jobs = 20
FDAddress = 127.0.0.1
PKI Signatures = Yes
PKI Encryption = Yes
PKI Keypair = "/etc/bacula/keys/bacula-fd.pem"
PKI Master Key = "/etc/bacula/keys/master.cert"
}
Here's an example job spec:
Job {
Name = "ias"
JobDefs = "Standard"
Schedule = "With-Basejobs"
FileSet = "ias"
Accurate = yes
Base = "ias-base"
}
Job {
Name = "ias-base"
Level = Base
JobDefs = "Standard"
FileSet = "ias"
Schedule = "Update-Basejobs"
Accurate = yes
}
FileSet {
Name = "ias"
Include {
Options {
BaseJob = pmugcs5
Accurate = mcs5
Verify = pin5
signature = MD5
compression=GZIP
}
File = /nas/ias
}
Exclude {
File = /nas/exclude
}
}
Storage def from bacula-dir.conf:
Storage {
Name = Tandberg
Address = 127.0.0.1
SDPort = 9103
Password = "e3Ci8AxSF2ewxzX2VgaU"
Device = Tandberg
Autochanger = yes
Media Type = LTO3
Maximum Concurrent Jobs = 20
AllowCompression = yes
}
Devices in bacula-sd.conf:
Autochanger {
Name = Tandberg
Device = IBM0, IBM1
Changer Device = /dev/sg6
Changer Command = "/usr/lib64/bacula/mtx-changer %c %o %S %a %d"
}
Device {
Name = IBM0
Drive Index = 0
Media Type = LTO3
Archive Device = /dev/st0
AutomaticMount = yes;
AlwaysOpen = yes;
RemovableMedia = yes;
RandomAccess = no;
Autochanger = yes;
Maximum Concurrent Jobs = 2
Spool Directory = "/opt/spool/ibm0"
}
Device {
Name = IBM1
Drive Index = 1
Media Type = LTO3
Archive Device = /dev/st1
AutomaticMount = yes;
AlwaysOpen = yes;
RemovableMedia = yes;
RandomAccess = no;
Autochanger = yes;
Maximum Concurrent Jobs = 2
Spool Directory = "/opt/spool/ibm1"
}
Could it be the "compression=GZIP" in the job defs that is slowing
things down?
I really should get my colleague to join this as he's the one that set
this up.
Cheers
Alex
--
This message is intended only for the addressee and may contain
confidential information. Unless you are that person, you may not
disclose its contents or use it in any way and are requested to delete
the message along with any attachments and notify us immediately.
"Transact" is operated by Integrated Financial Arrangements plc
Domain House, 5-7 Singer Street, London EC2A 4BQ
Tel: (020) 7608 4900 Fax: (020) 7608 5300
(Registered office: as above; Registered in England and Wales under number:
3727592)
Authorised and regulated by the Financial Services Authority (entered on the
FSA Register; number: 190856)
--
Get your Android app more play: Bring it to the BlackBerry PlayBook
in minutes. BlackBerry App World™ now supports Android™ Apps
for the BlackBerry® PlayBook™. Discover just how easy and simple
it is! http://p.sf.net/sfu/android-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] [Bacula-devel] Bacula Version 5.2.1 released
> - Ability to Verify any specified Job Thank You very much for implementing this. I will test as soon as I can. Many times at work (academic department of ~20 users, ~50 machines and ~50TB of data) I have wanted to verify my jobs but the previous functionality was not very functional for me especially since I run concurrent jobs and the last job on a client was almost always not the one I wanted to verify.. John -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula Version 5.2.1 released
Hello, Today, we released Bacula version 5.2.1. If you downloaded version 5.2.0, sorry for the inconvenience, but I *strongly recommend you download version 5.2.1 to avoid possible problems. Several people have commented lately that the Bacula project appears dead, but it is not at all the case. The developers have been working hard. Since version 5.0.3, there have been over 299,387 lines of changes made by 20 developers, making 1,851 commits to the git repo, and we have closed 88 bug reports (the large part of them being fixed). There are also some nice new features -- some of the main ones are: - LZO Compression - New Tray Monitor - Purge Migration Job - Changes in Bvfs (Bacula Virtual FileSystem) - Changes in the Pruning Algorithm - Ability to Verify any specified Job - Additions to RunScript variables - Additions to the Plugin API - ACL enhancements - XATTR enhancements - Class Based Database Backend Drivers - Hash List Enhancements Bacula 5.2.1 is now available for download from Source Forge, where you can also find the ReleaseNotes, or you can read them at the following link: http://www.bacula.org/en/?page=news and the New Features section of the manual is at: http://www.bacula.org/5.2.x-manuals/en/main/main/New_Features_in_5_2_x.html Enjoy. Best regards, Kern -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] HW crypto offload
On Tue, Oct 18, 2011 at 9:37 AM, Alex Crow wrote: > Hi, > > We have set up a backup server that uses encryption in the File Daemon. > However we find it is really slow, in fact we are only getting about > 80Mbps (megabits, not -bytes) throughput while running 4 backup threads. > This is backing up from an NFS-connected disk backup host that can > easily saturate a 1Gbps link when I just dd the contents of a large file > to /dev/null on the backup server. It's actually taking us nearly a week > now to do a fortnightly backup of 16TB. > > I've noticed that crypto cards from Exar are supported by OpenSSL and > seen to provide support for AES-CBC. From a previous message on this list: > > http://adsm.org/lists/html/Bacula-users/2010-04/msg00232.html > > it seems someone looked at patching to support offload, however I cannot > find any outcome from this. > > If it is supported in any way, I'd be happy to know. If not, what would > be the best way about getting it implemented? I'd want to be pretty sure its going to help before doing this. On my (somewhat aged) development machine, OpenSSL can do AES-128 CBC at 55 MB/s (bytes, not bits), so it doesn;t sound like crypto is necessarily your bottleneck. Also, crypto "accelerators" rarely do in my experience. > > Best regards > > Alex > > -- > This message is intended only for the addressee and may contain > confidential information. Unless you are that person, you may not > disclose its contents or use it in any way and are requested to delete > the message along with any attachments and notify us immediately. > > "Transact" is operated by Integrated Financial Arrangements plc > Domain House, 5-7 Singer Street, London EC2A 4BQ > Tel: (020) 7608 4900 Fax: (020) 7608 5300 > (Registered office: as above; Registered in England and Wales under > number: 3727592) > Authorised and regulated by the Financial Services Authority (entered on > the FSA Register; number: 190856) > > > -- > All the data continuously generated in your IT infrastructure contains a > definitive record of customers, application performance, security > threats, fraudulent activity and more. Splunk takes this data and makes > sense of it. Business sense. IT sense. Common sense. > http://p.sf.net/sfu/splunk-d2d-oct > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
