Re: [Bacula-users] Restore to Windows Client
Op 8/06/2011 6:12, Christian Tardif schreef: Hi all, I've configured the Windows client as per the documentation found on the Internet. The only intended use for this client is for restore purposes, as the data backed up comes from the Linux box, which gets the Windows data from rsync. Anyway When I try to restore, I don't get any particular problem. The Director eventually send a message telling that the restore went well. In my test, 7 files expected, 7 files received. But, on Windows, no files at all. So, I expect that the problem comes from either the folder structure on the Windows side, or on the Where clause from my Restore job. Let's say I would want to restore to c:\tmp\bacula-restores. How should the Where clause be typed? Thanks! Christian.. Are you sure you're restoring to the windows client and not to the linux box? If the backup runs on the linux box chances are the default restore location is there aswell. So maybe they'll be under /c:/tmp/bacula-restores on the linux box if that's what you filled in under where? Regards, Jeremy DISCLAIMER http://www.schaubroeck.be/maildisclaimer.htm -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Second Instance of Bacula Direcktor
Hello list, in our environment, we have on-site and off-site backups running. Now we are planning to migrate all off-site backups to an second instance of bacula-director. It is possible to install an second director on the same machine? Can this instance use the same mysql-database, or i have to install an new database...? If so, how can i migrate all off-site database entries to the new one? Are there an migration path?. Thanks for help. Best regards JHN -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: Director Control Protocol
On Tue, 7 Jun 2011 16:53:24 -0700 (PDT), Tim Gustafson said: I was asking if there was any documentation on the protocol that bconsole uses to talk to the director daemon. It would appear that the answer is no. Thanks anyhow! The protocol is very minimal -- it just sends what the user types and outputs what the director returns. __Martin -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Second Instance of Bacula Direcktor
On Wed, 08 Jun 2011 11:02:47 +0200, Joris Heinrich said: It is possible to install an second director on the same machine? Yes -- use a different bacula-dir.conf containing a different port number. Can this instance use the same mysql-database, or i have to install an new database...? If so, how can i migrate all off-site database entries to the new one? Are there an migration path?. It must use a different database. Migrating individual entries is difficult, so possibly the simplest way is to clone the entire database using MySQL tools and then use bconsole to delete the entries for the on-site jobs, volumes and pools. __Martin -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Second Instance of Bacula Direcktor
Hello Martin, thanks for your help... i will try this.. Best regards JHN Am 08.06.11 13:57, schrieb Martin Simmons: On Wed, 08 Jun 2011 11:02:47 +0200, Joris Heinrich said: It is possible to install an second director on the same machine? Yes -- use a different bacula-dir.conf containing a different port number. Can this instance use the same mysql-database, or i have to install an new database...? If so, how can i migrate all off-site database entries to the new one? Are there an migration path?. It must use a different database. Migrating individual entries is difficult, so possibly the simplest way is to clone the entire database using MySQL tools and then use bconsole to delete the entries for the on-site jobs, volumes and pools. __Martin -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fwd: Director Control Protocol
Op 20110608 om 02:11 schreef Tim Gustafson: http://bacula.org/5.0.x-manuals/en/developers/developers/Protocol_Used_Between_Direc.html#SECTION0065 That appears to be the protocol between the director and the file daemon, not bconsole. FWIW there is bacula developers mailinglist HtH -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director Control Protocol
Il 07/06/2011 18:35, Tim Gustafson ha scritto: Hi, I was wondering if there is any documentation anywhere on the protocol that bconsole uses to connect to the director and issue commands? I've built a web interface to the Bacula configuration files, and I would like to add the ability to reload the configuration and/or start or cancel jobs from that web interface as well. If it's not well documented, I'll just tcpdump the connection between bconsole and the director itself and try to reverse-engineer it, but I was hoping that it was actually documented somewhere. BTW: I don't need comments about re-inventing the wheel - I know there are other web-based Bacula tools out there; I built this one with specific organizational needs in mind. All I want to know is if the protocol between bconsole and the director is documented somewhere. I did find some documentation on the protocols for director-fd, direcdtor-sd and fd-sd, but nothing about bconsole-director. -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Tim Gustafsont...@soe.ucsc.edu Baskin School of Engineering 831-459-5354 UC Santa Cruz Baskin Engineering 317B -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users I may sound silly, but have you tried looking at the source code ? -- Marcello Romani -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Is Bacula MAID Aware?
I'm look to purchase a new storage system for our backups. Does bacula support MAID storage systems? Is anyone currently using MAID configured systems with Bacula? MAID = A storage system comprising an arrayhttp://snia.org/education/dictionary/a#array of disk drives that are powered down individually or in groups when not required. MAID Definitions: http://snia.org/education/dictionary/m#massive_array_of_idle_disks http://www.sgi.com/products/storage/maid/what.html Anthony Avarca aava...@anl.gov 630.252.4940 -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Database performance issues
Hi All, We have a setup with bacula-dir/MySQL and bacula-sd (2 servers) and a SAN connected via fiber. We are running bacula with about 250 jobs a day. The table File is about 500M records with a size of about 100G. We use batch insert. All tables are MyISAM. Currently we are experiencing performance problems with the database. For all jobs we do a disk-to-disk backup. The next day we use a copyjob to put the data on tape. During daytime we run the copy jobs and during the evening/night we run the disk-to-disk jobs. There is some overlap. When the the disk-to-disk jobs start, we see number of queries on the database drop to virtually 0. There are a few options to solve this - use innodb for the tables in MySQL - migrate to PostgreSQL Can anyone advise me what to do, to increase the performance of our platform? Kind regards, Enrico van Goor -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Director Control Protocol
On 06/07/2011 05:52 PM, Tim Gustafson wrote: Can't you spawn bconsole from the web application? That is what most of the other web apps do. [...] I'm hoping that there might be a protocol that cuts out all the screen parsing and instead lets me just do something like: 1. Connect to the bacula-dir daemon 2. Authenticate 3. Send a command like show status client blah.foo.bar-fd and have that return machine-parse-able status information, rather than human-readable information. You can skip the parse the list of clients step by just sending status client=blah.foo.bar-fd directly to bconsole, but I personally would also love to see more easily machine-parseable output - just adding to bconsole's commands themselves an out=xml or out=json or similar modifier that returns the information in an easier to parse form instead of the default human readable form would be extremely useful to me. (I wrote a web-interface script that talks to bconsole. Getting the response isn't really that hard, but I do end up going through a series of regex's to pick out the individual bits of information that I want from the output, which is obviously kind of a pain.) -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
On 06/08/11 08:06, Enrico van Goor wrote: Hi All, We have a setup with bacula-dir/MySQL and bacula-sd (2 servers) and a SAN connected via fiber. We are running bacula with about 250 jobs a day. The table File is about 500M records with a size of about 100G. We use batch insert. All tables are MyISAM. Currently we are experiencing performance problems with the database. For all jobs we do a disk-to-disk backup. The next day we use a copyjob to put the data on tape. During daytime we run the copy jobs and during the evening/night we run the disk-to-disk jobs. There is some overlap. When the the disk-to-disk jobs start, we see number of queries on the database drop to virtually 0. There are a few options to solve this - use innodb for the tables in MySQL - migrate to PostgreSQL Can anyone advise me what to do, to increase the performance of our platform? The very first thing I would do would be upgrade to MySQL 5.5.[current] (5.5.13, right now) if you're not already using 5.5, making sure it's properly configured (hint: look at the new configuration directive innodb_buffer_pool_instances), then throw as much RAM as possible at the InnoDB buffer pool and convert all of the tables to InnoDB. Then download MySQltuner (http://mysqltuner.com/mysqltuner.pl) and look at its recommendations for some basic tuning. MyISAM, frankly, *SHOULD* be deprecated at this point. There is still a lot of FUD about InnoDB performance out there, most of it from people who don't actually understand the performance implications of the differences between MyISAM and InnoDB, but the truth is there is virtually no use case on a conventional MySQL server[1] for which What primary storage engine should I be using? has any answer other than InnoDB. It's probably not too inaccurate to say that unless you *NEED* either merge tables or full-text indices, you should be using InnoDB. [1] Which is to say, not NDB Cluster -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
On Wed, 08 Jun 2011 10:50:58 -0400, Phil Stracchino ala...@metrocast.net wrote: The very first thing I would do would be upgrade to MySQL 5.5.[current] (5.5.13, right now) if you're not already using 5.5, making sure it's properly configured (hint: look at the new configuration directive innodb_buffer_pool_instances), then throw as much RAM as possible at the InnoDB buffer pool and convert all of the tables to InnoDB. Then download MySQltuner (http://mysqltuner.com/mysqltuner.pl) and look at its recommendations for some basic tuning. InnoDB is not so easy to setup. The biggest buffer is not always the best one. innodb_buffer_size should be bigger than innodb data pieces. You should seize logfiles according to the database activity. You should set innodb_file_per_table... and so on... When we are speaking about Mysql performance, you could have a look on InnoDB plugin. Barracuda file format is much faster than the previous one, the innodb plugin is known to improve performance. MyISAM, frankly, *SHOULD* be deprecated at this point. There is still a lot of FUD about InnoDB performance out there, most of it from people who don't actually understand the performance implications of the differences between MyISAM and InnoDB, but the truth is there is virtually no use case on a conventional MySQL server[1] for which What primary storage engine should I be using? has any answer other than InnoDB. It's probably not too inaccurate to say that unless you *NEED* either merge tables or full-text indices, you should be using InnoDB. SELECT are slower on a InnoDB table. (but is much more reliable) When the database has a really slow update frequency, MyISAM can be interesting. For bacula purposes, I would suggest to use mysqltuner.pl and tuning-primer.sh to detect some incorrect values. They can improve performance a lot. HTH. Jérôme Blion. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
Hi, On Wed, 08 Jun 2011, Phil Stracchino wrote: The very first thing I would do would be upgrade to MySQL 5.5.[current] (5.5.13, right now) if you're not already using 5.5, making sure it's properly configured (hint: look at the new configuration directive innodb_buffer_pool_instances), then throw as much RAM as possible at the InnoDB buffer pool and convert all of the tables to InnoDB. Then download MySQltuner (http://mysqltuner.com/mysqltuner.pl) and look at its recommendations for some basic tuning. MyISAM, frankly, *SHOULD* be deprecated at this point. There is still a lot of FUD about InnoDB performance out there, most of it from people who don't actually understand the performance implications of the differences between MyISAM and InnoDB, but the truth is there is virtually no use case on a conventional MySQL server[1] for which What primary storage engine should I be using? has any answer other than InnoDB. It's probably not too inaccurate to say that unless you *NEED* either merge tables or full-text indices, you should be using InnoDB. For simplicity of operation and patching, we're using the Ubuntu archive packages which are MySQL 5.1.41. I realise that's quite old now. There are one or two restores in particular which take a long time (like 30 minutes) to build the restore tree. I'm guessing the reason is these tables: -rw-rw 1 mysql mysql 7.4G 2011-06-08 13:24 File.MYD -rw-rw 1 mysql mysql 5.1G 2011-06-08 13:24 File.MYI -rw-rw 1 mysql mysql 233M 2011-06-08 13:24 Filename.MYI -rw-rw 1 mysql mysql 161M 2011-06-08 13:24 Filename.MYD -rw-rw 1 mysql mysql 153M 2011-06-08 13:24 Path.MYI -rw-rw 1 mysql mysql 99M 2011-06-08 13:24 Path.MYD Addressing this with a move to PostgreSQL has been on my list but I might try a move to InnoDB first as it's likely much simpler. Assuming that version of MySQL, do you know if the case for InnoDB vs MyISAM is still as cut and dry? Would we likely see substantial performance improvements? Thanks for any help, Gavin -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
Le 08/06/2011 18:16, Gavin McCullagh a écrit : Hi, On Wed, 08 Jun 2011, Phil Stracchino wrote: The very first thing I would do would be upgrade to MySQL 5.5.[current] (5.5.13, right now) if you're not already using 5.5, making sure it's properly configured (hint: look at the new configuration directive innodb_buffer_pool_instances), then throw as much RAM as possible at the InnoDB buffer pool and convert all of the tables to InnoDB. Then download MySQltuner (http://mysqltuner.com/mysqltuner.pl) and look at its recommendations for some basic tuning. MyISAM, frankly, *SHOULD* be deprecated at this point. There is still a lot of FUD about InnoDB performance out there, most of it from people who don't actually understand the performance implications of the differences between MyISAM and InnoDB, but the truth is there is virtually no use case on a conventional MySQL server[1] for which What primary storage engine should I be using? has any answer other than InnoDB. It's probably not too inaccurate to say that unless you *NEED* either merge tables or full-text indices, you should be using InnoDB. For simplicity of operation and patching, we're using the Ubuntu archive packages which are MySQL 5.1.41. I realise that's quite old now. There are one or two restores in particular which take a long time (like 30 minutes) to build the restore tree. I'm guessing the reason is these tables: -rw-rw 1 mysql mysql 7.4G 2011-06-08 13:24 File.MYD -rw-rw 1 mysql mysql 5.1G 2011-06-08 13:24 File.MYI -rw-rw 1 mysql mysql 233M 2011-06-08 13:24 Filename.MYI -rw-rw 1 mysql mysql 161M 2011-06-08 13:24 Filename.MYD -rw-rw 1 mysql mysql 153M 2011-06-08 13:24 Path.MYI -rw-rw 1 mysql mysql 99M 2011-06-08 13:24 Path.MYD Addressing this with a move to PostgreSQL has been on my list but I might try a move to InnoDB first as it's likely much simpler. Assuming that version of MySQL, do you know if the case for InnoDB vs MyISAM is still as cut and dry? Would we likely see substantial performance improvements? Thanks for any help, Gavin Hello, You will see performance improvements if you have lot of concurrents updates. Which Bacula version do you have ? Perhaps it's an index issue. HTH Jérôme Blion -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
On 06/08/11 11:44, Jérôme Blion wrote: On Wed, 08 Jun 2011 10:50:58 -0400, Phil Stracchino ala...@metrocast.net wrote: The very first thing I would do would be upgrade to MySQL 5.5.[current] (5.5.13, right now) if you're not already using 5.5, making sure it's properly configured (hint: look at the new configuration directive innodb_buffer_pool_instances), then throw as much RAM as possible at the InnoDB buffer pool and convert all of the tables to InnoDB. Then download MySQltuner (http://mysqltuner.com/mysqltuner.pl) and look at its recommendations for some basic tuning. InnoDB is not so easy to setup. The biggest buffer is not always the best one. innodb_buffer_size should be bigger than innodb data pieces. You should seize logfiles according to the database activity. You should set innodb_file_per_table... and so on... Well, obviously, yes. I wasn't trying to give a complete MySQL tuning guide in a single message. I will note' however, that benchmarking has demonstrated that InnoDB performance scales more or less linearly with InnoDB buffer pool size up to about 300GB. When we are speaking about Mysql performance, you could have a look on InnoDB plugin. Barracuda file format is much faster than the previous one, the innodb plugin is known to improve performance. This is outdated information dating from MySQL 5.1. In MySQL 5.5 there is only one InnoDB storage engine, and it is a newer, more advanced, and better-performing engine than the MySQL 5.1 InnoDB plugin. SELECT are slower on a InnoDB table. (but is much more reliable) When the database has a really slow update frequency, MyISAM can be interesting. Actually, this is one of the misconceptions. I actually had cause recently to do some benchmarking of MySQL on top of several different underlying storage options. One of the things that did come out of the test is that, on MySQL 5.5 at least, even in a 100% read workload - which is the best possible performance case for MyISAM - InnoDB still consistently outperformed MyISAM by approximately 60%. (For the record, in a 25% write/75% read workload on the same configuration, InnoDB outperformed MyISAM by 400%.) -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
On 06/08/11 12:16, Gavin McCullagh wrote: For simplicity of operation and patching, we're using the Ubuntu archive packages which are MySQL 5.1.41. I realise that's quite old now. There are one or two restores in particular which take a long time (like 30 minutes) to build the restore tree. I'm guessing the reason is these tables: -rw-rw 1 mysql mysql 7.4G 2011-06-08 13:24 File.MYD -rw-rw 1 mysql mysql 5.1G 2011-06-08 13:24 File.MYI -rw-rw 1 mysql mysql 233M 2011-06-08 13:24 Filename.MYI -rw-rw 1 mysql mysql 161M 2011-06-08 13:24 Filename.MYD -rw-rw 1 mysql mysql 153M 2011-06-08 13:24 Path.MYI -rw-rw 1 mysql mysql 99M 2011-06-08 13:24 Path.MYD Addressing this with a move to PostgreSQL has been on my list but I might try a move to InnoDB first as it's likely much simpler. Assuming that version of MySQL, do you know if the case for InnoDB vs MyISAM is still as cut and dry? Would we likely see substantial performance improvements? The performance difference is not going to be *as* large on 5.1, but particularly in a write-heavy workload such as Bacula, you should still expect to see a very significant performance improvement. As Jérôme observed, if you're tied to 5.1, you should use the plugin InnoDB engine rather than the built-in InnoDB engine if at all possible. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
Hi, On Wed, 08 Jun 2011, Jérôme Blion wrote: Assuming that version of MySQL, do you know if the case for InnoDB vs MyISAM is still as cut and dry? Would we likely see substantial performance improvements? You will see performance improvements if you have lot of concurrents updates. Which Bacula version do you have ? Perhaps it's an index issue. Bacula package for Ubuntu v5.0.1-1ubuntu1 Gavin -- Gavin McCullagh Senior System Administrator IT Services Griffith College South Circular Road Dublin 8 Ireland Tel: +353 1 4163365 http://www.gcd.ie http://www.gcd.ie/brochure.pdf http://www.gcd.ie/opendays http://www.gcd.ie/ebrochure This E-mail is from Griffith College. The E-mail and any files transmitted with it are confidential and may be privileged and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the addressee you are prohibited from disclosing its content, copying it or distributing it otherwise than to the addressee. If you have received this e-mail in error, please immediately notify the sender by replying to this e-mail and delete the e-mail from your computer. Bellerophon Ltd, trades as Griffith College (registered in Ireland No. 60469) with its registered address as Griffith College Campus, South Circular Road, Dublin 8, Ireland. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
On Wed, 08 Jun 2011, Jérôme Blion wrote: You will see performance improvements if you have lot of concurrents updates. I don't imagine concurrent updates are really an issue for us. Our backups run fast enough generally for our purposes . I daresay they could be faster, but they're not causing us a problem. It's the time for a restore to build the file tree that's a problem. The particularly bad restore in question is a Cyrus IMAP server with about 5 million files in a full backup. The worst case would be a monthly full, a weekly differential and 6 days of incrementals to assemble. Gavin -- Gavin McCullagh Senior System Administrator IT Services Griffith College South Circular Road Dublin 8 Ireland Tel: +353 1 4163365 http://www.gcd.ie http://www.gcd.ie/brochure.pdf http://www.gcd.ie/opendays http://www.gcd.ie/ebrochure This E-mail is from Griffith College. The E-mail and any files transmitted with it are confidential and may be privileged and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the addressee you are prohibited from disclosing its content, copying it or distributing it otherwise than to the addressee. If you have received this e-mail in error, please immediately notify the sender by replying to this e-mail and delete the e-mail from your computer. Bellerophon Ltd, trades as Griffith College (registered in Ireland No. 60469) with its registered address as Griffith College Campus, South Circular Road, Dublin 8, Ireland. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
Le 08/06/2011 19:16, Gavin McCullagh a écrit : On Wed, 08 Jun 2011, Jérôme Blion wrote: You will see performance improvements if you have lot of concurrents updates. I don't imagine concurrent updates are really an issue for us. Our backups run fast enough generally for our purposes . I daresay they could be faster, but they're not causing us a problem. It's the time for a restore to build the file tree that's a problem. The particularly bad restore in question is a Cyrus IMAP server with about 5 million files in a full backup. The worst case would be a monthly full, a weekly differential and 6 days of incrementals to assemble. Gavin What tool do you use to perform restore ? I had such issues with BAT... With Webacula, I am not able to reproduce this behaviour. Perhaps a bad query which does not use an index. HTH. Jérôme Blion. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
There are a few options to solve this - use innodb for the tables in MySQL - migrate to PostgreSQL anybody already did a successfull migration from MySQL to PostgreSQL? and willing to share a procedure? is it really possible to migrate the complete catalog? thanks, christian -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
On 06/08/11 13:45, Jérôme Blion wrote: I had such issues with BAT... With Webacula, I am not able to reproduce this behaviour. Very interesting. Perhaps a bad query which does not use an index. Definitely worth study. -- Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355 ala...@caerllewys.net ala...@metrocast.net p...@co.ordinate.org Renaissance Man, Unix ronin, Perl hacker, SQL wrangler, Free Stater It's not the years, it's the mileage. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
Hi, On Wed, 08 Jun 2011, Jérôme Blion wrote: What tool do you use to perform restore ? bconsole: restore 5 (Select the most recent backup for a client) choose host then building directory tree takes ages. I had such issues with BAT... With Webacula, I am not able to reproduce this behaviour. Perhaps a bad query which does not use an index. Sounds plausible. Does your issue occur with bconsole? Gavin -- Gavin McCullagh Senior System Administrator IT Services Griffith College South Circular Road Dublin 8 Ireland Tel: +353 1 4163365 http://www.gcd.ie http://www.gcd.ie/brochure.pdf http://www.gcd.ie/opendays http://www.gcd.ie/ebrochure This E-mail is from Griffith College. The E-mail and any files transmitted with it are confidential and may be privileged and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the addressee you are prohibited from disclosing its content, copying it or distributing it otherwise than to the addressee. If you have received this e-mail in error, please immediately notify the sender by replying to this e-mail and delete the e-mail from your computer. Bellerophon Ltd, trades as Griffith College (registered in Ireland No. 60469) with its registered address as Griffith College Campus, South Circular Road, Dublin 8, Ireland. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Is Bacula MAID Aware?
On 08/06/11 15:27, Avarca, Anthony wrote: I'm look to purchase a new storage system for our backups. Does bacula support MAID storage systems? Is anyone currently using MAID configured systems with Bacula? MAID is essentially transparent to bacula or the OS. If the drives are spun down they will take a little longer to respond to their first commands. I have several MAID arrays and bacula doesn't even realise they're any different to normal disks. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore to Windows Client
On 08/06/2011 00:57, James Harper wrote: If the files were backed up from C:\dir1\dir2\dir3, and you tell bacula to restore to C:\tmp\bacula-restores, it will restore to C:\tmp\bacula-restores\c\dir1\dir2\dir3. You can use a regexwhere to remove the C:\dir1\dir2\dir3 prefix and replace it with a C:\tmp\bacula-restores prefix. That said, the files should have been restored somewhere if Bacula says it was successful... OK, so if I understand correctly (since my files are backed up from a Linux box under /mnt/rsync/blahblah/thisfile.txt, restoring this file to my Windows box should be available under c:\tmp\bacula-restores\mnt\rsync\blahblah\thisfile.txt. But since this is a unix path (so these are slashes, not backslashes), would it try to restore to c:\tmp\bacula-restores\mnt/rsync/blahblah/thisfile.txt which wouldn't work, since / in a filename can't be ? Or does the Windows client do the translation itself? I will try right away to create a regex to manulaay translate a / to \, and see how it works, in case this is the problem. The file hasn't been restore at all, to answer the question. I've searched a file ending with thisfile.txt (for example), and it just wasn't there at all. Christian... -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore to Windows Client
On 08/06/2011 04:27, Jeremy Maes wrote: Op 8/06/2011 6:12, Christian Tardif schreef: Hi all, I've configured the Windows client as per the documentation found on the Internet. The only intended use for this client is for restore purposes, as the data backed up comes from the Linux box, which gets the Windows data from rsync. Anyway When I try to restore, I don't get any particular problem. The Director eventually send a message telling that the restore went well. In my test, 7 files expected, 7 files received. But, on Windows, no files at all. So, I expect that the problem comes from either the folder structure on the Windows side, or on the Where clause from my Restore job. Let's say I would want to restore to c:\tmp\bacula-restores. How should the Where clause be typed? Thanks! Christian.. Are you sure you're restoring to the windows client and not to the linux box? If the backup runs on the linux box chances are the default restore location is there aswell. So maybe they'll be under /c:/tmp/bacula-restores on the linux box if that's what you filled in under where? No, when I sent the restore, in the bat window, I made sure that the Windows client was selected. and that, under that this particular Restore job, the Client was my Windows box. Christian... -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore to Windows Client
On 08/06/2011 10:42, Bob Hetzel wrote: Certain versions prior to the current 5.0.3 client had an issue where they marked the directories as hidden. You could cd into them from a command prompt but you couldn't see them from explorer or a 'dir' command. See if you can cd into the directory you expect the files at. If that's the case, upgrade all your windows clients to the 5.0.3 version and next time that won't be an issue. Not the case. My client is 5.0.3 and no hidden files Christian... From: Christian Tardif christian.tar...@servinfo.ca Subject: [Bacula-users] Restore to Windows Client To: bacula-users@lists.sourceforge.net Message-ID: 4deef6ac.1080...@servinfo.ca Content-Type: text/plain; charset=ISO-8859-1; format=flowed Hi all, I've configured the Windows client as per the documentation found on the Internet. The only intended use for this client is for restore purposes, as the data backed up comes from the Linux box, which gets the Windows data from rsync. Anyway When I try to restore, I don't get any particular problem. The Director eventually send a message telling that the restore went well. In my test, 7 files expected, 7 files "received". But, on Windows, no files at all. So, I expect that the problem comes from either the folder structure on the Windows side, or on the Where clause from my Restore job. Let's say I would want to restore to c:\tmp\bacula-restores. How should the Where clause be typed? Thanks! Christian... -- Christian Tardif, Servinfo Inc. Tl: 514.237.6332 Courriel: christian.tar...@servinfo.ca Web: http://www.servinfo.ca SVP, pensez lenvironnement avant dimprimer ce message. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore to Windows Client
-Original Message- From: Christian Tardif [mailto:christian.tar...@servinfo.ca] Sent: Thursday, 9 June 2011 10:17 Cc: bacula-users@lists.sourceforge.net Subject: Re: [Bacula-users] Restore to Windows Client On 08/06/2011 00:57, James Harper wrote: If the files were backed up from C:\dir1\dir2\dir3, and you tell bacula to restore to C:\tmp\bacula-restores, it will restore to C:\tmp\bacula-restores\c\dir1\dir2\dir3. You can use a regexwhere to remove the C:\dir1\dir2\dir3 prefix and replace it with a C:\tmp\bacula-restores prefix. That said, the files should have been restored somewhere if Bacula says it was successful... OK, so if I understand correctly (since my files are backed up from a Linux box under /mnt/rsync/blahblah/thisfile.txt, restoring this file to my Windows box should be available under c:\tmp\bacula- restores\mnt\rsync\blahblah\thisfile.txt. But since this is a unix path (so these are slashes, not backslashes), would it try to restore to c:\tmp\bacula- restores\mnt/rsync/blahblah/thisfile.txt which wouldn't work, since / in a filename can't be ? Or does the Windows client do the translation itself? I will try right away to create a regex to manulaay translate a / to \, and see how it works, in case this is the problem. The file hasn't been restore at all, to answer the question. I've searched a file ending with thisfile.txt (for example), and it just wasn't there at all. You should always use /'s under Bacula. Bacula will take care of substituting it appropriately under Windows. James -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Restore to Windows Client
On 08/06/2011 21:06, James Harper wrote: Just to put that to bed, can you do 'status client' in bconsole for the windows client and confirm that the windows client thinks it ran the restore, just in case bat didn't do what you asked it to? Finally found out. In the whole bunch of tests I did in the Restore Job section, (mainly the where clause), I tried so many things (backslashes, forwardslashes, preceding C:, no preceding C:, etc, etc... It seems I tried everything, but not c:/tmp/bacula-restores/ Shame on me. But hey, this was not completely helpless. I never tried to do a status client. Now, I know this exists. I should definitely read completely the fancy manuals. Many thanks! Christian... -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Encryption times [SEC=UNCLASSIFIED]
UNCLASSIFIED Hi Everybody, I've just setup encryption on our bacula backup using the explaination in chapter 39 of the Bacula manual - it has blown out our backup time from overnight to 3 days ? Is this normal ? Is there any way to get the time down? It is only backing up 1.5Tb onto a tape library Alan Langley Digital Preservation Systems Manager The National Archives of Australia http://www.naa/gov/au UNCLASSIFIED -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
