Re: [Bacula-users] LTO media type mixup
Am 02.03.2012 03:02, schrieb mark.berg...@uphs.upenn.edu: = I have replaced the previous LTO-1 drive by an LTO-2 one. = [...] When I mounted the current backup tape in the new = drive, Bacula [...] refused to use it. The only difference was that = it had media type LTO-1 and Bacula requested LTO-2. Did you make any change to the bacula configuration, specifically the Media Type definition in bacula-sd.conf? Indeed, I commented out the device section LTO-1 in bacula-sd.conf and uncommented the LTO-2 section instead, effectively changing both Name and Media Type from LTO-1 to LTO-2, and adapted bacula-dir.conf accordingly. I guess that was my mistake. = - If I connect two LTO drives of different levels to the = same Bacula server, is there a way to use the same tape = alternatingly in both drives as supported by the = hardware? (*without* losing the data on it, that is) Yes. Don't change the Media Type string in bacula-sd.conf. In our environment, we've migrated from LTO-2 = LTO-3 = LTO-4. The current library can read LTO-2 tapes, and can write to LTO-3 (as per the LTO standard). Our bacula-sd.conf definition for Media Type still has LTO-2, and that's written to all the tapes, including the LTO-3 and LTO-4 tapes, when they are labeled. Makes sense. In that case, wouldn't it be better if the default bacula-sd.conf distributed with Bacula would just say Media Type = LTO for all the LTO devices? That would reduce the temptation to change that field when changing drives. Another question: Is there a way to fix the mix-up I've created? update volume doesn't let me change the media type. Can I just run the MySQL query update Media set MediaType = 'LTO-2' where MediaType = 'LTO-1' or is there more to it? Thanks, Tilman -- Tilman Schmidt Phoenix Software GmbH Bonn, Germany -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Multi-cores compression
Hello, I'd like to know if there is a way to allow the use of multi-cores during a backup and especially for the compression of the data? Thanks and regards, Gael This e-mail, including any attached files, may contain confidential and privileged information for the sole use of the intended recipient. Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive information for the intended recipient), please contact the sender by reply e-mail and delete all copies of this message. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Multi-cores compression
Hello, I'd like to know if there is a way to allow the use of multi-cores during a backup and especially for the compression of the data? Thanks and regards, Gael Guilmin This e-mail, including any attached files, may contain confidential and privileged information for the sole use of the intended recipient. Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive information for the intended recipient), please contact the sender by reply e-mail and delete all copies of this message. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Transfert a Volume to another storage daemon ?
Hi all, I have two storage daemon with file device on each. I know that i can't use a copy job to transfer a Volume between my two storage daemon, but i need to transfert all my volumes on my second storage. Do you have any solution to my problem ? Thanks Olivier L. smime.p7s Description: Signature cryptographique S/MIME -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO media type mixup
On Mon, Mar 05, 2012 at 11:00:06AM +0100, Tilman Schmidt wrote: Makes sense. In that case, wouldn't it be better if the default bacula-sd.conf distributed with Bacula would just say Media Type = LTO for all the LTO devices? That would reduce the temptation to change that field when changing drives. Well, 'Media Type' is misleading. It is more a 'Media Group'. every medium in the same group can be requested on every SD that support that 'Media Group'. It doesn't actually have anything to do with the mediums capabilities/size. Another question: Is there a way to fix the mix-up I've created? update volume doesn't let me change the media type. Can I just run the MySQL query update Media set MediaType = 'LTO-2' where MediaType = 'LTO-1' or is there more to it? Should work and worked elsewhere. Regards, Adrian -- LiHAS - Adrian Reyer - Hessenwiesenstraße 10 - D-70565 Stuttgart Fon: +49 (7 11) 78 28 50 90 - Fax: +49 (7 11) 78 28 50 91 Mail: li...@lihas.de - Web: http://lihas.de Linux, Netzwerke, Consulting Support - USt-ID: DE 227 816 626 Stuttgart -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
I’d like to know if there is a way to allow the use of multi-cores during a backup and especially for the compression of the data? I do not believe this is available in bacula at the moment. However you may be able to turn compression off and use a filesystem that supports compression like btrfs, zfs, resier4 or one of the fuse filesystems. Although I am not sure which of these use multithreaded compression. John -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
On 05/03/12 14:00, Gael Guilmin wrote: Hello, I'd like to know if there is a way to allow the use of multi-cores during a backup and especially for the compression of the data? Why do you want compression? -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Transfert a Volume to another storage daemon ?
Hi Olivier, bacula does not support copy and migration jobs between two storages daemons, but I have a workaround to this: configure you target sd with a same name device on source sd and mount it with nfs. Start a copy or migration job and observe logs. Kleber 2012/3/5 Olivier L. oliv...@luckol.net Hi all, I have two storage daemon with file device on each. I know that i can't use a copy job to transfer a Volume between my two storage daemon, but i need to transfert all my volumes on my second storage. Do you have any solution to my problem ? Thanks Olivier L. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Transfert a Volume to another storage daemon ?
2012/3/5 Olivier L. oliv...@luckol.net: Hi all, I have two storage daemon with file device on each. I know that i can't use a copy job to transfer a Volume between my two storage daemon, but i need to transfert all my volumes on my second storage. Do you have any solution to my problem ? rsync John -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
To gain space on the LT0. -Original Message- From: Alan Brown [mailto:a...@mssl.ucl.ac.uk] Sent: Monday, March 05, 2012 3:33 PM To: Gael Guilmin Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Multi-cores compression On 05/03/12 14:00, Gael Guilmin wrote: Hello, I'd like to know if there is a way to allow the use of multi-cores during a backup and especially for the compression of the data? Why do you want compression? -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users This e-mail, including any attached files, may contain confidential and privileged information for the sole use of the intended recipient. Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive information for the intended recipient), please contact the sender by reply e-mail and delete all copies of this message. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Transfert a Volume to another storage daemon ?
On Monday 05 March 2012 14:53:55 Olivier L. wrote: Hi all, I have two storage daemon with file device on each. I know that i can't use a copy job to transfer a Volume between my two storage daemon, but i need to transfert all my volumes on my second storage. Do you have any solution to my problem ? Thanks Olivier L. Doesn't it suffice to just copy them over (by eg. rsync)? Or why do you have to do it at all? I've found that when it comes to purging and re-using the volume files, it's enough for the files to just exist (ie. doesn't matter whether they actually contain any data). -- Silver -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
Compressing a compressed file will not help that much. I've found I get much better compression and speed with the built in compressions on my LTO-4 Drives. On Mon, 5 Mar 2012 14:24:41 + Gael Guilmin gael.guil...@pdgm.com wrote: To gain space on the LT0. -Original Message- From: Alan Brown [mailto:a...@mssl.ucl.ac.uk] Sent: Monday, March 05, 2012 3:33 PM To: Gael Guilmin Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Multi-cores compression On 05/03/12 14:00, Gael Guilmin wrote: Hello, I'd like to know if there is a way to allow the use of multi-cores during a backup and especially for the compression of the data? Why do you want compression? -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users This e-mail, including any attached files, may contain confidential and privileged information for the sole use of the intended recipient. Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive information for the intended recipient), please contact the sender by reply e-mail and delete all copies of this message. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Craig Van Tassle HUBzero.org System Administrator YONG 1006 Desk Phone : (765)496-6413 -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
No, you dont need software compression to save space on LTO drive. LTO drives are hardware compression enabled. You will need software compression only for file based volumes. Kleber 2012/3/5 Gael Guilmin gael.guil...@pdgm.com To gain space on the LT0. -Original Message- From: Alan Brown [mailto:a...@mssl.ucl.ac.uk] Sent: Monday, March 05, 2012 3:33 PM To: Gael Guilmin Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Multi-cores compression On 05/03/12 14:00, Gael Guilmin wrote: Hello, I'd like to know if there is a way to allow the use of multi-cores during a backup and especially for the compression of the data? Why do you want compression? -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users This e-mail, including any attached files, may contain confidential and privileged information for the sole use of the intended recipient. Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive information for the intended recipient), please contact the sender by reply e-mail and delete all copies of this message. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
On Mon, Mar 5, 2012 at 9:24 AM, Gael Guilmin gael.guil...@pdgm.com wrote: To gain space on the LT0. You mean tape. Do not use bacula compression with tape. The HW does compression automatically and it is much faster. John -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO media type mixup
On 05/03/12 14:17, Adrian Reyer wrote: On Mon, Mar 05, 2012 at 11:00:06AM +0100, Tilman Schmidt wrote: Makes sense. In that case, wouldn't it be better if the default bacula-sd.conf distributed with Bacula would just say Media Type = LTO for all the LTO devices? That would reduce the temptation to change that field when changing drives. Well, 'Media Type' is misleading. It is more a 'Media Group'. every medium in the same group can be requested on every SD that support that 'Media Group'. It doesn't actually have anything to do with the mediums capabilities/size. Correct. To add confusion, any given bacula drive can only support one media type. The only way around this problem is to define extra drives for each media type supported (ie, LTO5, LTO4 and (read-only) LTO3). I don't know how well this solution will work in terms of concurrency, I'm about to try it as I've been told to reuse ~200 LTO4 tapes from another project. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
Thanks for the answer. When you say at the moment, you mean that in the future it'll? Possibly. This is covered by a few planned projects. http://bacula.org/en/?page=feature-request http://www.bacula.org/git/cgit.cgi/bacula/plain/bacula/projects?h=Branch-5.2 John -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
On 05/03/12 14:24, Gael Guilmin wrote: To gain space on the LT0. Don't bother. 1: Compression maxes out at about 30MB/s 2: LTO has inbuilt hardware compression which is good enough and a _LOT_ faster than any CPU you can throw at the task. The _only_ use for compression is on slow WAN links and when writing to disk - and for the latter I'd consider using compressing FSes such as ZFS in preference to using Bacula compression. -Original Message- From: Alan Brown [mailto:a...@mssl.ucl.ac.uk] Sent: Monday, March 05, 2012 3:33 PM To: Gael Guilmin Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Multi-cores compression On 05/03/12 14:00, Gael Guilmin wrote: Hello, I'd like to know if there is a way to allow the use of multi-cores during a backup and especially for the compression of the data? Why do you want compression? -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users This e-mail, including any attached files, may contain confidential and privileged information for the sole use of the intended recipient. Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive information for the intended recipient), please contact the sender by reply e-mail and delete all copies of this message. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
Ok I didn't know that. Thank you for your help! Gael -Original Message- From: John Drescher [mailto:dresche...@gmail.com] Sent: Monday, March 05, 2012 3:30 PM To: Gael Guilmin Cc: Alan Brown; bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Multi-cores compression On Mon, Mar 5, 2012 at 9:24 AM, Gael Guilmin gael.guil...@pdgm.com wrote: To gain space on the LT0. You mean tape. Do not use bacula compression with tape. The HW does compression automatically and it is much faster. John This e-mail, including any attached files, may contain confidential and privileged information for the sole use of the intended recipient. Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive information for the intended recipient), please contact the sender by reply e-mail and delete all copies of this message. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
On 3/5/2012 9:45 AM, Alan Brown wrote: On 05/03/12 14:24, Gael Guilmin wrote: To gain space on the LT0. Don't bother. 1: Compression maxes out at about 30MB/s 2: LTO has inbuilt hardware compression which is good enough and a _LOT_ faster than any CPU you can throw at the task. The _only_ use for compression is on slow WAN links and when writing to disk - and for the latter I'd consider using compressing FSes such as ZFS in preference to using Bacula compression. Additionally, Bacula compression is performed by the FD, and in many cases the client machines being backed up, laptops, etc., are not very capable. Using filesystem compression moves the compression task to the SD. The same goes for encryption. And good enough is exactly the point. It is possible that a high performance server could encrypt/compress faster than the LTO drive's embedded hardware. Also, consider that, since Bacula performs compression on the FD, it already makes use of multiple cores when backing up multiple clients simultaneously. Certainly, if you backed up enough clients in parallel then the net compression rate would exceed the LTO drive's hardware compression rate. But why bother? The limit is still the raw write speed of the drive/media. As long as the drive's hardware compression/encryption can keep the tape spooling, it is fast enough. If it is not fast enough for the application, then additional LTO drives are needed. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
On 05/03/12 15:08, Alex Crow wrote: On 05/03/12 14:45, Alan Brown wrote: On 05/03/12 14:24, Gael Guilmin wrote: To gain space on the LT0. Don't bother. 1: Compression maxes out at about 30MB/s 2: LTO has inbuilt hardware compression which is good enough and a _LOT_ faster than any CPU you can throw at the task. The _only_ use for compression is on slow WAN links and when writing to disk - and for the latter I'd consider using compressing FSes such as ZFS in preference to using Bacula compression. What about when you are encrypting? You have to do the compression in Bacula as once you've encrypted the data it can no longer be compressed by the drive (eg for LTO LTO4 where the drive cannot encrypt.) Encryption programs generally compress as well in order to increase entropy - so any external compression routines will just make things slower for no gain. As soon as you're doing things which slow down the data flow you have to put up with painfully slow (for me) throughput and you _MUST_ use disk spooling to prevent tape drive shoeshining(*). Multithreading might help but it's generally only available for block-based compression algorithms such as bzip2 (multithreaded decompression isn't available for Pbzip) and that's not going to help much on a stream-based setup such as bacula without major rewrites. Encrypted setups are fine, but bear in mind that 2% of data losses are down to loss of keys - and while a damaged enencrypted backup might be partially recoverable its' highly likely that damage on an encrypted one will result in 100% loss. (*) Anything which results in uncompressed data being presented to the tape drive at a minimum throughput of less than 200MB/s will result in shoeshining (even though the actual tape rate is less than this, if the data is compressaable it needs to feed the drive fast enough to avoid the tape stopping or slowing down. Highly compressable data may require much faster minimum throughputs.) Even slow spool disks are a problem. You can test this by measuring throughput to /dev/null -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO media type mixup
Am 05.03.2012 15:43, schrieb Alan Brown: On 05/03/12 14:17, Adrian Reyer wrote: Well, 'Media Type' is misleading. It is more a 'Media Group'. every medium in the same group can be requested on every SD that support that 'Media Group'. It doesn't actually have anything to do with the mediums capabilities/size. To add confusion, any given bacula drive can only support one media type. The only way around this problem is to define extra drives for each media type supported (ie, LTO5, LTO4 and (read-only) LTO3). What's wrong with just defining a single media type LTO covering all generations in use? -- Tilman Schmidt Phoenix Software GmbH Bonn, Germany -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re : Restore on windows with VSS stops file daemon service
Hi, VSS can execute backups of openfiles. I dont think it can make restores of files that are being used (Not sure, could anyone confirm ?). Regards HC On Mon, Mar 5, 2012 at 3:47 PM, claude baryo clo...@yahoo.fr wrote: Hi again, Just to inform you that, I installed the bacula client 5.2.3, the restore job is ok with the following error. see below : Have you an idea ? 05-Mar 16:40 vm-dev5-bacula-srv-dir JobId 148: Start Restore Job Restore-for-winsys-clt.2012-03-05_16.39.57_09 05-Mar 16:40 vm-dev5-bacula-srv-dir JobId 148: Using Device DD-File 05-Mar 16:40 vm-dev5-bacula-srv-sd JobId 148: Ready to read from volume Geny-vol3-clt on device DD-File (/bacula_sources/bacula-storage). 05-Mar 16:40 vm-dev5-bacula-srv-sd JobId 148: Forward spacing Volume Geny-vol3-clt to file:block 0:25778033. 05-Mar 16:40 clt-bacula-win1-fd JobId 148: Error: /home/kern/bacula/k/bacula/src/findlib/create_file.c:395 Could not open D:/sources/: ERR=Le processus ne peut pas accéder au fichier car ce fichier est utilisé par un autre processus. 05-Mar 16:40 clt-bacula-win1-fd JobId 148: VSS Writer (RestoreComplete): Task Scheduler Writer, State: 0x1 (VSS_WS_STABLE) 05-Mar 16:40 clt-bacula-win1-fd JobId 148: VSS Writer (RestoreComplete): VSS Metadata Store Writer, State: 0x1 (VSS_WS_STABLE) 05-Mar 16:40 clt-bacula-win1-fd JobId 148: VSS Writer (RestoreComplete): Performance Counters Writer, State: 0x1 (VSS_WS_STABLE) 05-Mar 16:40 clt-bacula-win1-fd JobId 148: VSS Writer (RestoreComplete): System Writer, State: 0x1 (VSS_WS_STABLE) 05-Mar 16:40 clt-bacula-win1-fd JobId 148: VSS Writer (RestoreComplete): ASR Writer, State: 0x1 (VSS_WS_STABLE) 05-Mar 16:40 clt-bacula-win1-fd JobId 148: VSS Writer (RestoreComplete): Shadow Copy Optimization Writer, State: 0x1 (VSS_WS_STABLE) 05-Mar 16:40 clt-bacula-win1-fd JobId 148: VSS Writer (RestoreComplete): Registry Writer, State: 0x1 (VSS_WS_STABLE) 05-Mar 16:40 clt-bacula-win1-fd JobId 148: VSS Writer (RestoreComplete): COM+ REGDB Writer, State: 0x1 (VSS_WS_STABLE) 05-Mar 16:40 clt-bacula-win1-fd JobId 148: VSS Writer (RestoreComplete): WMI Writer, State: 0x1 (VSS_WS_STABLE) 05-Mar 16:40 vm-dev5-bacula-srv-dir JobId 148: Error: Bacula vm-dev5-bacula-srv-dir 5.2.4 (18Jan12): Build OS: i686-pc-linux-gnu debian 6.0.3 JobId: 148 Job: Restore-for-winsys-clt.2012-03-05_16.39.57_09 Restore Client: clt-bacula-win1-fd Start time: 05-Mar-2012 16:40:00 End time: 05-Mar-2012 16:40:06 Files Expected: 8 Files Restored: 7 Bytes Restored: 2,238,899 Rate: 373.1 KB/s FD Errors: 1 FD termination status: Error SD termination status: OK Termination: *** Restore Error *** 05-Mar 16:40 vm-dev5-bacula-srv-dir JobId 148: Begin pruning Jobs older than 6 months . 05-Mar 16:40 vm-dev5-bacula-srv-dir JobId 148: No Jobs found to prune. 05-Mar 16:40 vm-dev5-bacula-srv-dir JobId 148: Begin pruning Files. 05-Mar 16:40 vm-dev5-bacula-srv-dir JobId 148: No Files found to prune. 05-Mar 16:40 vm-dev5-bacula-srv-dir JobId 148: End auto prune. De : claude baryo clo...@yahoo.fr À : hugo.alex.card...@gmail.com hugo.alex.card...@gmail.com Envoyé le : Lundi 5 mars 2012 16h00 Objet : [Bacula-users] Restore on windows with VSS stops file daemon service Hi Alex, I've the same problem as you. When I try to restore for Bacula windows client, the daemond client going down and a receive the following error message : -- my win fileset - for your information FileSet { Name = WinSys-test-GI Enable VSS = Yes Include { File = D:/sources Options { signature = MD5 compression=GZIP IgnoreCase = yes Exclude=yes wild =.*.avi. wild =.*.mp3? wild =.*.mpg. wilddir = C:/PerfLogs wilddir = C:/Windows wilddir = *temporary internet files* wilddir = Programmes wilddir = Program Files (x86) wildfile = *pagefile.sys wildfile = *.log wildfile = *system32/perflib*.dat } } } = Backup status == for your information 05-Mar 15:48 vm-dev5-bacula-srv-dir JobId 144: Start Backup JobId 144, Job=Bckp-winsys-GI-1.2012-03-05_15.48.27_11 05-Mar 15:48 vm-dev5-bacula-srv-dir JobId 144: Using Device DD-File 05-Mar 15:48 clt-bacula-win1-fd JobId 144: DIR and FD clocks differ by 18 seconds, FD automatically compensating. 05-Mar 15:48 vm-dev5-bacula-srv-sd JobId 144: Volume Geny-vol3-clt previously written, moving to end of data. 05-Mar 15:48 vm-dev5-bacula-srv-sd JobId 144: Ready to append to end of Volume Geny-vol3-clt size=36014317 05-Mar 15:48 clt-bacula-win1-fd JobId 144: Generate VSS snapshots. Driver=Win64 VSS, Drive(s)=D 05-Mar 15:48 clt-bacula-win1-fd JobId 144: VSS Writer (BackupComplete):
Re: [Bacula-users] LTO media type mixup
On Mon, Mar 5, 2012 at 10:44 AM, Tilman Schmidt t.schm...@phoenixsoftware.de wrote: Am 05.03.2012 15:43, schrieb Alan Brown: On 05/03/12 14:17, Adrian Reyer wrote: Well, 'Media Type' is misleading. It is more a 'Media Group'. every medium in the same group can be requested on every SD that support that 'Media Group'. It doesn't actually have anything to do with the mediums capabilities/size. To add confusion, any given bacula drive can only support one media type. The only way around this problem is to define extra drives for each media type supported (ie, LTO5, LTO4 and (read-only) LTO3). What's wrong with just defining a single media type LTO covering all generations in use? The problem is that you may want to separate your volumes so bacula does not want to try to write to an LTO2 tape on an LTO5 drive. Remember that with LTO drives you can read 2 generations back but only write 1 generation back. John -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] NDMP Plugin coming to community release?
Just wondering if anyone knows if the NDMP plugin will be coming to the community release of Bacula anytime soon. Yours, Shon -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO media type mixup
In the message dated: Mon, 05 Mar 2012 11:05:28 EST, The pithy ruminations from John Drescher on Re: [Bacula-users] LTO media type mixup were: = On Mon, Mar 5, 2012 at 10:44 AM, Tilman Schmidt = t.schm...@phoenixsoftware.de wrote: = Am 05.03.2012 15:43, schrieb Alan Brown: = On 05/03/12 14:17, Adrian Reyer wrote: = = Well, 'Media Type' is misleading. It is more a 'Media Group'. every = medium in the same group can be requested on every SD that support that = 'Media Group'. It doesn't actually have anything to do with the mediums = capabilities/size. Good explanation. I'd strongly support changing the name of the directive in the configuration file to something like Media Group. = = To add confusion, any given bacula drive can only support one media type. = Yeah I guess it would make sense if Media Group was a list of supported strings, not a single value. In this model, sites with multiple devices (tape libraries, disk storage arrays, etc) could use multiple media types, with each physical device being assigned a list of media types (in a Media Group) that the device can use. Furthermore, the device definition in bacula-sd.conf could list properties for each media type. For example: Device { Name = lto5-changer Media Group = LTO3, LTO4, LTO5 Media Options { LTO3 = ReadOnly LTO4 = ReadWrite LTO5 = ReadWrite } } Device { Name = lto4-changer Media Group = LTO2, LTO3, LTO4 Media Options { LTO2 = ReadOnly LTO3 = ReadWrite LTO4 = ReadWrite } } Device { Name = File Media Group = localNAS, remoteNAS_for_DR Media Options { localNAS = ReadWrite remoteNAS_for_DR = ReadOnly } } = The only way around this problem is to define extra drives for each = media type supported (ie, LTO5, LTO4 and (read-only) LTO3). = = What's wrong with just defining a single media type LTO covering all = generations in use? = = = The problem is that you may want to separate your volumes so bacula = does not want to try to write to an LTO2 tape on an LTO5 drive. = Remember that with LTO drives you can read 2 generations back but only = write 1 generation back. When we moved to an LTO4 library, our solution to that issue was to update the volume status on all the LTO-2 media to Read-Only (in the bacula database, but this could have been done with the physical read-only tab on each tape). Obviously, this would be a problem if we wanted to use both the LTO3 and LTO4 libraries. Thanks, Mark = = = John = = -- = Try before you buy = See our experts in action! = The most comprehensive online learning library for Microsoft developers = is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, = Metro Style Apps, more. Free future releases when you subscribe now! = http://p.sf.net/sfu/learndevnow-dev2 = ___ = Bacula-users mailing list = Bacula-users@lists.sourceforge.net = https://lists.sourceforge.net/lists/listinfo/bacula-users = -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
What about when you are encrypting? You have to do the compression in Bacula as once you've encrypted the data it can no longer be compressed by the drive (eg for LTO LTO4 where the drive cannot encrypt.) Encryption programs generally compress as well in order to increase entropy - so any external compression routines will just make things slower for no gain. Thanks Alan, I am specifically addressing the encryption support within Bacula: http://www.bacula.org/en/dev-manual/main/main/Data_Encryption.html Does this pre-compress the data, thus rendering the separate compression redundant? If so, it would be great and probably save us loads of time (about 1 week to back up about 18TB). Cheers Alex -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Deduplication / Base jobs
Hi, I have read and tried to understand File Deduplication : http://www.bacula.org/en/dev-manual/main/main/File_Deduplication_using_Ba.html But it is not working : # - POOL: base - Pool { Name= base_backup Pool Type = Backup Storage = storage UseVolumeOnce = yes Maximum Volume Jobs = 1 Volume Use Duration = 10 hours Volume Retention= 1 month Recycle Oldest Volume = yes Label Format= ${Job}.${Level:p/4/B/r:l}.${JobId}.${Year}-${Month:p/2/0/r}-${Day:p/2/0/r} } # - POOL: full - Pool { Name= full_backup Pool Type = Backup Storage = storage UseVolumeOnce = yes Maximum Volume Jobs = 1 Volume Use Duration = 10 hours Volume Retention= 6 days Recycle Oldest Volume = yes Label Format= ${Job}.${Level:p/4/F/r:l}.${JobId}.${Year}-${Month:p/2/0/r}-${Day:p/2/0/r} } # - POOL: incr - Pool { Name= incr_backup Pool Type = Backup Storage = storage UseVolumeOnce = yes Maximum Volume Jobs = 1 Volume Use Duration = 10 hours Volume Retention= 6 days Recycle Oldest Volume = yes Label Format= ${Job}.${Level:p/4/I/r:l}.${JobId}.${Year}-${Month:p/2/0/r}-${Day:p/2/0/r} } # - JOB: base - Job { Name = base_job Type = Backup Level= Base Client = server_one FileSet = fs_generic Schedule = 00_base Pool = base_backup Max Run Time = 5 hours Reschedule On Error = yes Reschedule Interval = 1 hours # Client Run Before Job= bash -c '/usr/local/bin/dump_bacula.sh' Messages = Standard } # - JOB: cycle Job { Name = full_job Type = Backup Level= Incremental Client = server_one Base = full_job, base_job Accurate = yes FileSet = fs_generic Schedule = 00_full_incr Pool = incr_backup Full Backup Pool = full_backup Incremental Backup Pool = incr_backup Max Run Time = 5 hours Reschedule On Error = yes Reschedule Interval = 1 hours Messages = Standard } Schedule { Name = 00_full_incr Run = Level=Fullmon at 23:00 Run = Level=Incremental tue at 14:30 Run = Level=Incremental wed at 14:30 Run = Level=Fullthu at 23:00 Run = Level=Incremental fri at 14:30 Run = Level=Incremental sat at 14:30 Run = Level=Fullsun at 23:00 } Schedule { Name = 00_base Run = Level=Full1st mon at 23:00 } FileSet { Name = fs_generic Include { Options { signature= SHA1 basejob = pmugcs1 accurate = mcs verify = pin1 onefs= no checkfilechanges = yes } File = /etc File = /root File = /usr/local File = /var/backups File = /var/spool/cron } Exclude { File = .snapshot File = .journal File = .fsck } } Base and Full are the same size. I can not find a sample configuration and the explanatory page is succinct. Can you help me ? Thanks in advance. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Override Next Pool
Very Nice! Thanks for the pointer, a very elegant work around. -Original Message- From: Adrian Reyer [mailto:bacula-li...@lihas.de] Sent: Friday, March 02, 2012 1:04 AM To: Tim Krieger Cc: 'bacula-users@lists.sourceforge.net' Subject: Re: [Bacula-users] Override Next Pool Hie Tim, On Thu, Mar 01, 2012 at 02:36:28PM -0800, Tim Krieger wrote: All our routine backups are done to disk to keep our backup window small Our data is rolled from disk to tape(long term archive) with a migration job weekly(file pool recycled after two weeks) I have been asked to add an additional offsite backup to this setup and was thinking of just running a copy job to usb disks. The snag I have run into is that the copy job just wants to send things to the tape archive as that is the next pool as defined in the file storage pool resources. Any ideas? Can I specify next pool in the run command somehow? I have the very same setup, I solved it with a wrapper job that changed the 'Next Pool' statement. If you want to, you can have the script. But recently Jan Lentfer asked basically the same in 'Virtual Full - Set NextPool for the virtual job only', Martin Simmons linked to http://thread.gmane.org/gmane.comp.sysutils.backup.bacula.devel/14084 and I like that approach quite more as it doesn't need bacula-dir reloading. I would do it that way if I had to do it again. Regards, Adrian -- LiHAS - Adrian Reyer - Hessenwiesenstraße 10 - D-70565 Stuttgart Fon: +49 (7 11) 78 28 50 90 - Fax: +49 (7 11) 78 28 50 91 Mail: li...@lihas.de - Web: http://lihas.de Linux, Netzwerke, Consulting Support - USt-ID: DE 227 816 626 Stuttgart This electronic mail transmission and any accompanying attachments contain confidential information intended only for the use of the individual or entity named above. Any dissemination, distribution, copying or action taken in reliance on the contents of this communication by anyone other than the intended recipient is strictly prohibited. If you have received this communication in error please immediately delete the e-mail and either notify the sender at the above e-mail address or by telephone at +1 250.386.5323. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] LTO media type mixup
On 05/03/12 18:11, mark.berg...@uphs.upenn.edu wrote: Yeah I guess it would make sense if Media Group was a list of supported strings, not a single value. I asked for this a few years ago. It never happened. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Tape management question
I currently do a full backup on Fridays and then another full backup on Saturdays to a set of disks that go offsite and are rotated every few weeks. After I put in the new drives with the same mount point and what not, Bacula hangs on the jobs saying that the previous volume is not available, which makes sense because they are offsite. So every Monday I come into work and manually set the Saturday's volumes from Append to Full which solves my issue. Is there a way to automate the process of changing the volume status to Full? I read that you can tell it how long to keep that volume open for, but from what I saw, the volume needs to be available on the next use before it figures out that it needs to create a new one. I am using Bacula 5.0.3 on Ubuntu 10.04 LTS +-- |This was sent by rmc...@teamdms.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Multi-cores compression
On 05/03/12 19:51, Alex Crow wrote: Thanks Alan, I am specifically addressing the encryption support within Bacula: http://www.bacula.org/en/dev-manual/main/main/Data_Encryption.html Openssl compresses _if_ compiled with zlib (it usually is) It's not hard to test, write to a file instead of tape media and compare size vs a tarball. If you are using a LTO device with built-in encryption then it's much faster as there is a dedicated engine for the task (LTO encryption is posrtable across drives as long as the key is retained) On that basis I'd only use bacula encryption for disk-based backups or on tape devices without builtin encyption. -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tape management question
You need only one Full backup. I should create a copy job to create off site media. The off site media (copy create by job copy) will be needed only when the primary copy is not available. Kleber 2012/3/5 DMS bacula-fo...@backupcentral.com I currently do a full backup on Fridays and then another full backup on Saturdays to a set of disks that go offsite and are rotated every few weeks. After I put in the new drives with the same mount point and what not, Bacula hangs on the jobs saying that the previous volume is not available, which makes sense because they are offsite. So every Monday I come into work and manually set the Saturday's volumes from Append to Full which solves my issue. Is there a way to automate the process of changing the volume status to Full? I read that you can tell it how long to keep that volume open for, but from what I saw, the volume needs to be available on the next use before it figures out that it needs to create a new one. I am using Bacula 5.0.3 on Ubuntu 10.04 LTS +-- |This was sent by rmc...@teamdms.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] TLS Causes SegFault on bacula-dir.
I've been trying to get TLS working in Bacula with out any luck. Every time I start Bacula the Director seg faults when trying to initialize TLS We are not using DNS. I'm not sure if that's a problem or not, but I thought I'd put it out there. We are just using a hosts file and the bacula server has an entry listing for it's shortname as well as FQDN. The server is running Centos 6.2 x86_64 RPM installed OpenSSL 1.0.0-20. Bacula Version: 5.2.3. All instances of hostnames and domains have been replaced with hostname.domain.com and domain. Configure Params for Bacula: $ ./configure --sbindir=/usr/local/bacula/sbin --sysconfdir=/usr/local/bacula/etc --with-pid-dir=/usr/local/bacula/working --with-subsys-dir=/usr/local/bacula/working --with-working-dir=/usr/local/bacula/working --with-dump-email=postmaster@domain --with-job-email=postmaster@domain --with-mysql=/data/mysql/ --with-python --with-open-ssl Generate key using openssl: openssl genrsa -des3 -out hostname.domain.com.key 1024 Created CSR: openssl req -new -key hostname.domain.com.key -out hostname.domain.com.key.csr Signed CSR with internal CA: openssl ca -batch -extensions bacula-client -days 1825 -out hostname.domain.com.pem -in hostname.domain.com.key.csr -config ca.cnf [bacula-client] is setup as the following in the ca.cnf: [ bacula_client ] basicConstraints = CA:false subjectKeyIdentifier = hash authorityKeyIdentifier = keyid,issuer keyUsage = digitalSignature, nonRepudiation, keyEncipherment, dataEncipherment, keyAgreement, keyCertSign, cRLSign, encipherOnly, decipherOnly extendedKeyUsage = critical, serverAuth, clientAuth Verified Cert with OpenSSL: openssl verify -CAfile CA.crt hostname.domain.com.pem hostname.domain.com.pem: OK I have tried a few other methods of generating keys - no luck with any method. bacula-dir.conf : Director { # define myself Name = hqpbkup-core01.2checkout.com-dir DIRport = 9101 # where we listen for UA connections QueryFile = /usr/local/bacula/etc/query.sql WorkingDirectory = /usr/local/bacula/working PidDirectory = /usr/local/bacula/working Maximum Concurrent Jobs = 1 Password = passwd # Console password Messages = Daemon TLS Enable = yes TLS Require = yes TLS Key = /usr/local/bacula/etc/bkup.key TLS Certificate = /usr/local/bacula/etc/bkup.pem TLS CA Certificate File = /usr/local/bacula/etc/domain-CA.crt TLS Verify Peer = yes TLS Allowed CN = bacula@hostname } Output of the btrack: [Thread debugging using libthread_db enabled] 0x00354300effe in waitpid () from /lib64/libpthread.so.0 $1 = '\000' repeats 29 times $2 = 0x1b4c078 bacula-dir $3 = 0x1b4c0b8 /usr/local/bacula/sbin/bacula-dir $4 = 0x0 $5 = 0x7f709ef8eb5b 5.2.3 (16 December 2011) $6 = 0x7f709ef8eb7c x86_64-unknown-linux-gnu $7 = 0x7f709ef8eb95 redhat $8 = 0x7f709ef8e83c $9 = hqpbkup-core01, '\000' repeats 35 times $10 = 0x7f709ef8eb74 redhat $11 = 0 Environment variable TestName not defined. #0 0x00354300effe in waitpid () from /lib64/libpthread.so.0 #1 0x7f709ef7a40d in signal_handler (sig=11) at signal.c:229 #2 signal handler called #3 0x003542c7a31c in free () from /lib64/libc.so.6 #4 0x7f709e9f7a8d in CRYPTO_free () from /usr/lib64/libcrypto.so.10 #5 0x7f709ea7a2ad in ASN1_STRING_free () from /usr/lib64/libcrypto.so.10 #6 0x7f709ea6eefd in ASN1_primitive_free () from /usr/lib64/libcrypto.so.10 #7 0x7f709ea6f2df in ASN1_template_free () from /usr/lib64/libcrypto.so.10 #8 0x7f709ea6f1c6 in ?? () from /usr/lib64/libcrypto.so.10 #9 0x7f709ea6f2df in ASN1_template_free () from /usr/lib64/libcrypto.so.10 #10 0x7f709ea6f1c6 in ?? () from /usr/lib64/libcrypto.so.10 #11 0x7f709ea6f315 in ASN1_item_free () from /usr/lib64/libcrypto.so.10 #12 0x003549c3f0aa in ?? () from /usr/lib64/libssl.so.10 #13 0x003549c3f2e6 in SSL_CTX_use_PrivateKey_file () from /usr/lib64/libssl.so.10 #14 0x7f709ef7ca69 in new_tls_context (ca_certfile=0x1b4e678 /usr/local/bacula/ssl/domain-CA.pem, ca_certdir=0x0, certfile=0x1b4e6d8 /usr/local/bacula/ssl/bkup.pem, keyfile=0x1b4e728 /usr/local/bacula/ssl/bkup.key, pem_callback=0, pem_userdata=value optimized out, dhfile=0x0, verify_peer=true) at tls.c:171 #15 0x0040d9ad in check_resources () at dird.c:662 #16 0x0040e3e8 in main (argc=value optimized out, argv=value optimized out) at dird.c:260 Thread 1 (Thread 0x7f709e9917e0 (LWP 20911)): #0 0x00354300effe in waitpid () from /lib64/libpthread.so.0 #1 0x7f709ef7a40d in signal_handler (sig=11) at signal.c:229 #2 signal handler called #3 0x003542c7a31c in free () from /lib64/libc.so.6 #4 0x7f709e9f7a8d in CRYPTO_free () from /usr/lib64/libcrypto.so.10 #5 0x7f709ea7a2ad in ASN1_STRING_free () from /usr/lib64/libcrypto.so.10 #6 0x7f709ea6eefd in ASN1_primitive_free () from /usr/lib64/libcrypto.so.10 #7 0x7f709ea6f2df in ASN1_template_free () from /usr/lib64/libcrypto.so.10 #8 0x7f709ea6f1c6 in ?? () from /usr/lib64/libcrypto.so.10 #9
[Bacula-users] Mysterious Director authentication failures
I'm running Bacula 5.2.5, with Director, catalog and a disk SD on a Solaris 10u9 machine, and a second SD (LTO4 tape) on a Gentoo Linux box. Bacula was compiled using gcc (x86_64-pc-linux-gnu-4.5.3) on the Linux box and with Sun Studio 12.2 opn the Solaris box. Recently I've started experiencing errors in which, after a number of successful connections, Director connection authentication begins repeatedly failing. Example: babylon4:root:/opt/bacula/etc:31 # bconsole Connecting to Director babylon4:9101 Director authorization problem. Most likely the passwords do not agree. If you are using TLS, there may have been a certificate validation error during the TLS handshake. Please see http://www.bacula.org/en/rel-manual/Bacula_Freque_Asked_Questi.html#SECTION00376 for help. From working/babylon4-dir.conmsg: 05-Mar 21:45 babylon4-dir: ERROR in authenticate.c:415 Unable to authenticate console *UserAgent* at client:10.24.32.10:36131. 05-Mar 21:45 babylon4-dir: ERROR in authenticate.c:415 Unable to authenticate console *UserAgent* at client:10.24.32.14:36131. 05-Mar 21:45 babylon4-dir: ERROR in authenticate.c:415 Unable to authenticate console *UserAgent* at client:10.24.32.14:36131. After starting the Director, all connections will succeed initially. All passwords are known good. As a general rule, once one connection attempt fails, all subsequent connection attempts will also fail. Connections are more likely to fail if one or more jobs is running at the time. Has anyone else encountered this or similar behavior? -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula-users Digest, Vol 71, Issue 5
Restore completado a las 3 de la mañana 06-Mar 00:47 srv-backup05-sd JobId 96529: End of Volume at file 720 on device Drive-1 (/dev/st1), Volume HMN538L4 06-Mar 00:48 srv-backup05-sd JobId 96529: 3307 Issuing autochanger unload slot 15, drive 0 command. 06-Mar 00:49 srv-backup05-sd JobId 96529: 3307 Issuing autochanger unload slot 38, drive 1 command. 06-Mar 00:51 srv-backup05-sd JobId 96529: 3304 Issuing autochanger load slot 38, drive 0 command. 06-Mar 00:52 srv-backup05-sd JobId 96529: 3305 Autochanger load slot 38, drive 0, status is OK. 06-Mar 00:52 srv-backup05-sd JobId 96529: Ready to read from volume HMN504L4 on device Drive-1 (/dev/st1). 06-Mar 00:52 srv-backup05-sd JobId 96529: Forward spacing Volume HMN504L4 to file:block 670:7296. 06-Mar 03:59 srv-backup05-dir JobId 96529: Bacula srv-backup05-dir 5.0.3 (04Aug10): 06-Mar-2012 03:59:26 Build OS: x86_64-unknown-linux-gnu redhat JobId: 96529 Job:RestoreFiles.2012-03-05_20.25.15_50 Restore Client: VM00294-macbavmex10be1-fd Start time: 05-Mar-2012 20:37:25 End time: 06-Mar-2012 03:59:26 Files Expected: 47 Files Restored: 47 Bytes Restored: 442,606,025,280 Rate: 16688.9 KB/s FD Errors: 0 FD termination status: OK SD termination status: OK Termination:Restore OK - Mensaje original - De: bacula-users-requ...@lists.sourceforge.net Para: bacula-users@lists.sourceforge.net Enviados: Martes, 6 de Marzo 2012 3:53:41 Asunto: Bacula-users Digest, Vol 71, Issue 5 Send Bacula-users mailing list submissions to bacula-users@lists.sourceforge.net To subscribe or unsubscribe via the World Wide Web, visit https://lists.sourceforge.net/lists/listinfo/bacula-users or, via email, send a message with subject or body 'help' to bacula-users-requ...@lists.sourceforge.net You can reach the person managing the list at bacula-users-ow...@lists.sourceforge.net When replying, please edit your Subject line so it is more specific than Re: Contents of Bacula-users digest... Today's Topics: 1. Re: LTO media type mixup (John Drescher) 2. NDMP Plugin coming to community release? (Mingus Dew) 3. Re: LTO media type mixup (mark.berg...@uphs.upenn.edu) 4. Re: Multi-cores compression (Alex Crow) 5. Deduplication / Base jobs (Julien S) 6. Re: Override Next Pool (Tim Krieger) 7. Re: LTO media type mixup (Alan Brown) 8. Tape management question (DMS) 9. Re: Multi-cores compression (Alan Brown) 10. Re: Tape management question (Kleber Leal) 11. TLS Causes SegFault on bacula-dir. (Rob Becker) 12. Mysterious Director authentication failures (Phil Stracchino) -- Message: 1 Date: Mon, 5 Mar 2012 11:05:28 -0500 From: John Drescher dresche...@gmail.com Subject: Re: [Bacula-users] LTO media type mixup To: Tilman Schmidt t.schm...@phoenixsoftware.de Cc: Adrian Reyer bacula-li...@lihas.de, Alan Brown a...@mssl.ucl.ac.uk, bacula-users@lists.sourceforge.net Message-ID: caehu1-7o4hqeaupcpfwalnmlbns9egbaes9dbmm0ypgtn4h...@mail.gmail.com Content-Type: text/plain; charset=ISO-8859-1 On Mon, Mar 5, 2012 at 10:44 AM, Tilman Schmidt t.schm...@phoenixsoftware.de wrote: Am 05.03.2012 15:43, schrieb Alan Brown: On 05/03/12 14:17, Adrian Reyer wrote: Well, 'Media Type' is misleading. It is more a 'Media Group'. every medium in the same group can be requested on every SD that support that 'Media Group'. It doesn't actually have anything to do with the mediums capabilities/size. To add confusion, any given bacula drive can only support one media type. The only way around this problem is to define extra drives for each media type supported (ie, LTO5, LTO4 and (read-only) LTO3). What's wrong with just defining a single media type LTO covering all generations in use? The problem is that you may want to separate your volumes so bacula does not want to try to write to an LTO2 tape on an LTO5 drive. Remember that with LTO drives you can read 2 generations back but only write 1 generation back. John -- Message: 2 Date: Mon, 5 Mar 2012 12:56:46 -0500 From: Mingus Dew shon.steph...@gmail.com Subject: [Bacula-users] NDMP Plugin coming to community release? To: bacula-users bacula-users@lists.sourceforge.net Message-ID: CAN7=ncihcsugzrwaqdrbyf0pkf+7aatcd0rfdlrw3hy3nsh...@mail.gmail.com Content-Type: text/plain; charset=ISO-8859-1 Just wondering if anyone knows if the NDMP plugin will be coming to the community release of Bacula anytime soon. Yours, Shon -- Message: 3 Date: Mon, 05 Mar 2012 13:11:26 -0500 From: mark.berg...@uphs.upenn.edu Subject: Re: [Bacula-users] LTO media type mixup To: John Drescher dresche...@gmail.com Cc: Adrian Reyer bacula-li...@lihas.de, Alan Brown