Re: [Bacula-users] new bacula install
Baldur Norddahl wrote: > Hi, > > I am installing bacula on a dedicated backup server running gentoo. The > server is a 3 GHz P4. The tapestreamer is an IBM Ultrium LTO 3 (400 GB > tapes uncompressed). > > I am going to backup 11 servers. Most of them are straightforward, but 4 > of them run large Postgresql databases, and I want to implement the new > point in time recovery feature of postgresql 8. > > So far it seems to work ok. But my full backups take too long. I enabled > concurrent jobs because no single server can deliver data as fast as the > streamer can write it. The problem seems to be that the backup server > goes to 100% CPU usage and the total throughput stays at 10-15 MB/s. > > I tested with dd, and managed to get about 73 MB/s copying a large file > with random data to the tape. If possible, I would want to get as close > to that as possible with the real backups. > > I installed with SQLlite for simplicy, and I realise that might be the > problem. Also my catalog size seems to be 1 GB already after just a few > days testing, and I read that SQLlite will only handle 2 GB catalog. So > I am going to recompile to postgresql, unless you guys tell me mysql is > really much better for this. I suppose I could let one of the large > postgresql database servers take the load, but I would rather not, to > prevent the backup system from generating huge amounts of useless > transaction logs. SQLite is generally recommended only for small installations with no other DB. PostgreSQL or MySQL is much preferred. Of the two, many reports indicate that Bacula does not perform well with PostgreSQL on backups, because PostgreSQL is much slower than MySQL on writes. There are tuning factors that can influence this. Also, have you tried using spooling? It is designed for situations in which your tape device is much faster than your clients can supply data. -- Phil Stracchino [EMAIL PROTECTED] Renaissance Man, Unix generalist, Perl hacker Mobile: 603-216-7037 Landline: 603-886-3518 --- SF.Net email is sponsored by: Tame your development challenges with Apache's Geronimo App Server. Download it for free - -and be entered to win a 42" plasma tv or your very own Sony(tm)PSP. Click here to play: http://sourceforge.net/geronimo.php ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] new bacula install
Phil Stracchino wrote: SQLite is generally recommended only for small installations with no other DB. PostgreSQL or MySQL is much preferred. Of the two, many reports indicate that Bacula does not perform well with PostgreSQL on backups, because PostgreSQL is much slower than MySQL on writes. There are tuning factors that can influence this. Also, have you tried using spooling? It is designed for situations in which your tape device is much faster than your clients can supply data. I did not try spooling for two reasons. First is that the backup server only has about 70 GB diskspace (two SATA disks in a mirror configuration). Many of the servers have more data to backup than this, and the total backup set is several times this. I got the impression that spooling only works if the backup server has enough diskspace to hold all the data from a single client. Second, the disks can in the best case only deliver about half the raw write speed of the tapestreamer. This is if the disks are not doing anything but reading. But in the spooling case the disks would still be spooling data from other clients, so I think I would get maybe 1/4 of the tapestreamers potential with this method. Thanks, Baldur --- SF.Net email is sponsored by: Tame your development challenges with Apache's Geronimo App Server. Download it for free - -and be entered to win a 42" plasma tv or your very own Sony(tm)PSP. Click here to play: http://sourceforge.net/geronimo.php ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] new bacula install
Hello, On 21.09.2005 09:23, Baldur Norddahl wrote: Phil Stracchino wrote: SQLite is generally recommended only for small installations with no other DB. PostgreSQL or MySQL is much preferred. Of the two, many reports indicate that Bacula does not perform well with PostgreSQL on backups, because PostgreSQL is much slower than MySQL on writes. There are tuning factors that can influence this. Also, have you tried using spooling? It is designed for situations in which your tape device is much faster than your clients can supply data. I did not try spooling for two reasons. First is that the backup server only has about 70 GB diskspace (two SATA disks in a mirror configuration). Many of the servers have more data to backup than this, and the total backup set is several times this. I got the impression that spooling only works if the backup server has enough diskspace to hold all the data from a single client. That's not a problem, although for your setup I would recommend something much larger... when the spool space is smaller than the data you need to backup, bacula first fills the spool space, writes that to tape, and continues reading from the clients and spooling. No problem, only it doesn't speed up the single backup, but with slow clients that prevents excessive shoe-shining. Second, the disks can in the best case only deliver about half the raw write speed of the tapestreamer. This is if the disks are not doing anything but reading. But in the spooling case the disks would still be spooling data from other clients, so I think I would get maybe 1/4 of the tapestreamers potential with this method. That's one big issue with todays tape drive :-) In a production system, I'd recommend a seriously fast RAID subsystem dedicated to spool space only... Arno Thanks, Baldur --- SF.Net email is sponsored by: Tame your development challenges with Apache's Geronimo App Server. Download it for free - -and be entered to win a 42" plasma tv or your very own Sony(tm)PSP. Click here to play: http://sourceforge.net/geronimo.php ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de --- SF.Net email is sponsored by: Tame your development challenges with Apache's Geronimo App Server. Download it for free - -and be entered to win a 42" plasma tv or your very own Sony(tm)PSP. Click here to play: http://sourceforge.net/geronimo.php ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] new bacula install
On Wed, 21 Sep 2005, Baldur Norddahl wrote: I did not try spooling for two reasons. First is that the backup server only has about 70 GB diskspace (two SATA disks in a mirror configuration). Many of the servers have more data to backup than this, and the total backup set is several times this. I got the impression that spooling only works if the backup server has enough diskspace to hold all the data from a single client. That's not correct, once the spool is full it's dumped to tape and then the sequece restarts, This may sound ineffeicient, but it saves a lot of wear and tear on fast tape drives by streaming data to the drive as fast as it can run, avoiding "shoe shining" (tape constantly rewinding and fast forwarding) which dramatically reduces a tape's throughput abilities. Second, the disks can in the best case only deliver about half the raw write speed of the tapestreamer. This is if the disks are not doing anything but reading. But in the spooling case the disks would still be spooling data from other clients, so I think I would get maybe 1/4 of the tapestreamers potential with this method. Why not get another drive just for spooling? --- SF.Net email is sponsored by: Tame your development challenges with Apache's Geronimo App Server. Download it for free - -and be entered to win a 42" plasma tv or your very own Sony(tm)PSP. Click here to play: http://sourceforge.net/geronimo.php ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] new bacula install
On Wed, 21 Sep 2005, Arno Lehmann wrote: That's not a problem, although for your setup I would recommend something much larger... when the spool space is smaller than the data you need to backup, bacula first fills the spool space, writes that to tape, and continues reading from the clients and spooling. No problem, only it doesn't speed up the single backup, but with slow clients that prevents excessive shoe-shining. The big advantages of spooling are: 1: It speeds up incremental backups 2: It allows multiple simultaneous backups to run efficiently. That's one big issue with todays tape drive :-) In a production system, I'd recommend a seriously fast RAID subsystem dedicated to spool space only... Spool data is transient and losing it isn't a big issue. Striping (raid 0) of temporary space is a much bigger win than any form of RAID unless you have a _very_ fast hardware controller. AB --- SF.Net email is sponsored by: Tame your development challenges with Apache's Geronimo App Server. Download it for free - -and be entered to win a 42" plasma tv or your very own Sony(tm)PSP. Click here to play: http://sourceforge.net/geronimo.php ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New Bacula Install
On Thursday 09 March 2006 23:49, Matthew Feinberg wrote: > Hey All, > > My name is Matthew Feinberg and I am getting ready to start a 150 client > Bacula implementation. I've spent the last week or so testing > Bacula on a small configuration and it works great.. Kudos to everyone > developing Bacula. > > To all the Bacula veterans: Before I get started is there any advice you > can provide or traps I should look out for? Read the chapter entitled "Critical Items to Implement before going Production". That should give you a good idea ... > > = > Matthew Feinberg [EMAIL PROTECTED] >http://www.bizwala.net > > > > > --- > This SF.Net email is sponsored by xPML, a groundbreaking scripting language > that extends applications into web and mobile media. Attend the live > webcast and join the prime developer group breaking into this new coding > territory! > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642 > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New bacula install
On 4/5/23 11:10, Andrew Meyer via Bacula-users wrote: I'm trying to set up bacula on AlmaLinux 8.7 w/ MariaDB 10.11 and getting the following error: $ sudo /usr/libexec/bacula/make_mysql_tables -u bacula -p Enter password: ERROR 1005 (HY000) at line 112: Can't create table `bacula`.`Job` (errno: 150 "Foreign key constraint is incorrectly formed") ERROR 1005 (HY000) at line 286: Can't create table `bacula`.`Pool` (errno: 150 "Foreign key constraint is incorrectly formed") Creation of Bacula MySQL tables succeeded. The error was much worse when I tried to run this as mysql root user. Can someone point me in the right direction to resolve this? Andrew, which version of Bacula? If you are seeing foreign key constraint failures, I suspect the general answer is "an old one", because no table in current Bacula releases contains foreign key constraints. They were removed a LONG time ago. -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New bacula install
Did you drop the database and recreate it after you tried to create the tables with the root user? That sounds like there were already tables there when you ran that command, and it couldn’t recreate them because of the constraints on the existing tables. If you don’t have any data it in, I would drop and recrecreate the database; then run that script again. Dan Rich | http://www.employees.org/~drich/ | "Step up to red alert!" "Are you sure, sir? | It means changing the bulb in the sign..." | - Red Dwarf (BBC) On April 5, 2023 at 08:14:06, Andrew Meyer via Bacula-users (bacula-users@lists.sourceforge.net) wrote: I'm trying to set up bacula on AlmaLinux 8.7 w/ MariaDB 10.11 and getting the following error: $ sudo /usr/libexec/bacula/make_mysql_tables -u bacula -p Enter password: ERROR 1005 (HY000) at line 112: Can't create table `bacula`.`Job` (errno: 150 "Foreign key constraint is incorrectly formed") ERROR 1005 (HY000) at line 286: Can't create table `bacula`.`Pool` (errno: 150 "Foreign key constraint is incorrectly formed") Creation of Bacula MySQL tables succeeded. The error was much worse when I tried to run this as mysql root user. Can someone point me in the right direction to resolve this? ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users signature.asc Description: Message signed with OpenPGP using AMPGpg ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New bacula install
[@bacula01 ~]$ rpm -qa|grep -i bacula bacula-storage-9.0.6-6.el8.x86_64 bacula-libs-9.0.6-6.el8.x86_64 bacula-director-9.0.6-6.el8.x86_64 bacula-client-9.0.6-6.el8.x86_64 bacula-common-9.0.6-6.el8.x86_64 bacula-libs-sql-9.0.6-6.el8.x86_64 bacula-console-9.0.6-6.el8.x86_64 [@bacula01 ~]$ On Wednesday, April 5, 2023 at 12:39:05 PM CDT, Phil Stracchino wrote: On 4/5/23 11:10, Andrew Meyer via Bacula-users wrote: > I'm trying to set up bacula on AlmaLinux 8.7 w/ MariaDB 10.11 and > getting the following error: > > $ sudo /usr/libexec/bacula/make_mysql_tables -u bacula -p > Enter password: > ERROR 1005 (HY000) at line 112: Can't create table `bacula`.`Job` > (errno: 150 "Foreign key constraint is incorrectly formed") > ERROR 1005 (HY000) at line 286: Can't create table `bacula`.`Pool` > (errno: 150 "Foreign key constraint is incorrectly formed") > Creation of Bacula MySQL tables succeeded. > > The error was much worse when I tried to run this as mysql root user. > > Can someone point me in the right direction to resolve this? Andrew, which version of Bacula? If you are seeing foreign key constraint failures, I suspect the general answer is "an old one", because no table in current Bacula releases contains foreign key constraints. They were removed a LONG time ago. -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New bacula install
On 4/6/23 09:09, Andrew Meyer via Bacula-users wrote: [@bacula01 ~]$ rpm -qa|grep -i bacula bacula-storage-9.0.6-6.el8.x86_64 bacula-libs-9.0.6-6.el8.x86_64 bacula-director-9.0.6-6.el8.x86_64 bacula-client-9.0.6-6.el8.x86_64 bacula-common-9.0.6-6.el8.x86_64 bacula-libs-sql-9.0.6-6.el8.x86_64 bacula-console-9.0.6-6.el8.x86_64 [@bacula01 ~]$ I suggest you get current release packages (13.0.2) from bacula.org and try that. -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New bacula install
I think these were provided from epel. Is there a rpm/yum repo provided by bacula?? Sent from Yahoo Mail on Android On Thu, Apr 6, 2023 at 8:20, Phil Stracchino wrote: On 4/6/23 09:09, Andrew Meyer via Bacula-users wrote: > [@bacula01 ~]$ rpm -qa|grep -i bacula > bacula-storage-9.0.6-6.el8.x86_64 > bacula-libs-9.0.6-6.el8.x86_64 > bacula-director-9.0.6-6.el8.x86_64 > bacula-client-9.0.6-6.el8.x86_64 > bacula-common-9.0.6-6.el8.x86_64 > bacula-libs-sql-9.0.6-6.el8.x86_64 > bacula-console-9.0.6-6.el8.x86_64 > [@bacula01 ~]$ I suggest you get current release packages (13.0.2) from bacula.org and try that. -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New bacula install
On 4/6/23 15:27, Andrew Meyer via Bacula-users wrote: I think these were provided from epel. Is there a rpm/yum repo provided by bacula?? Hello Andrew, https://www.bacula.org/bacula-binary-package-download/ Fill out the form and you will be emailed your one, unique download area of Bacula Community packages. Best regards, Bill -- Bill Arlofski w...@protonmail.com signature.asc Description: OpenPGP digital signature ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New bacula install
On 4/6/23 17:30, Bill Arlofski via Bacula-users wrote: On 4/6/23 15:27, Andrew Meyer via Bacula-users wrote: I think these were provided from epel. Is there a rpm/yum repo provided by bacula?? Hello Andrew, https://www.bacula.org/bacula-binary-package-download/ Fill out the form and you will be emailed your one, unique download area of Bacula Community packages. Be sure to drop your partly-created bacula database before you reinstall. -- Phil Stracchino Babylon Communications ph...@caerllewys.net p...@co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] new bacula install - keyboard scroll question
Oh curses, nevermind! previous directors: # grep curses config.log configure:22081: checking curses.h usability configure:22081: checking curses.h presence configure:22081: checking for curses.h ac_cv_header_curses_h=yes new director (forgot to install ncurses-devel): # grep curses config.log configure:22081: checking curses.h usability conftest.c:66:20: error: curses.h: No such file or directory | #include configure:22081: checking curses.h presence conftest.c:33:20: error: curses.h: No such file or directory | #include configure:22081: checking for curses.h configure:22214: checking for curses.h ac_cv_header_curses_h=no On 10/11/2015 8:50 PM, Randy Katz wrote: > Hi, > > I have several Bacula directors running. When I go into bconsole > and issue a command and then push up arrow it scrolls to the previous > command, as it should. I just setup a new Bacula server, same version > bacula-7.2.0 and same ./configure --with-mysql command and this > one does not scroll. I have verified scrolling is working at the OS level. > Is there anything in the conf files that could/would affect this? > > Best regards, > Randy Katz > > -- > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] new bacula install - keyboard scroll question
> Hi, > > I have several Bacula directors running. When I go into bconsole > and issue a command and then push up arrow it scrolls to the previous > command, as it should. I just setup a new Bacula server, same version > bacula-7.2.0 and same ./configure --with-mysql command and this > one does not scroll. I have verified scrolling is working at the OS level. > Is there anything in the conf files that could/would affect this? Hello Randy: installing libreadline6-dev (or the equivalent) and building binaries with the following options: [--with-readline=/usr/include/readline --disable-conio] should do the trick => http://bacula.us/compilation/ Besides history you will also have cleaning screen (ctrl+l) and reverse-i-search (ctrl+r) capabilities. > Best regards, > Randy Katz Regards, === Heitor Medrado de Faria - LPIC-III | ITIL-F | Bacula Systems Certified Administrator II Do you need Bacula training? https://www.udemy.com/bacula-backup-software/?couponCode=bacula-list I do Bacula training and deploy in any city of the world. More information: http://bacula.us/ +55 61 8268-4220 Site: http://bacula.us FB: heitor.faria === -- ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
