Re: [Bacula-users] Hardware Specs & Sizing for Bacula?
Wow that's quite a guide - appreciate that :)
I have to say that so far I've been very impressed with Bacula, my biggest
struggle has been finding the time to dedicate to it, and not trying to do
everything using the product we currently use as a reference point, which is
hard when you've used it for 10 years every day.
I think I get the "centralise" argument, but we may see that Linux file server
grow to be 30-40TB over the next few years and even whilst it won't all need
backing up I would be concerned if the folks using it do a job that generates a
huge amount of data as we just don't have 10GbE everywhere yet so I can't help
but think that being able to throw a £2.5k autoloader on that server directly
just to deal with that one box may be simpler but I'm very open to reasons for
and against.
The SSD speed delta makes sense, with our current backup product there is a
similar database and their spinning disk requirement was insane vs. a single
SSD (their database is disposable worst case, though it's still backed up daily
to avoid grief). We'd backup the database with Bacula too.
In our case the SSD is Intel S3500 which is "enterprise" grade by most
definitions, we have one free 2.5" bay in the server should another be needed
to RAID up, or I guess we have internal options - the box wasn't purchased with
Bacula specifically in mind, plans have changed a little.
Your tape suggestions are very helpful too thanks, we'd have 2x LTO6 drives for
Baculaw and we have physical storage covered, your comments about cleaning and
debris are interesting as Spectra sell their own "certified" media which is
supposed to deal with many issues and I did find myself deliberating whether
it's worth the premium but as you say backups are critical so I won't be giving
£10/extra per tape too much consideration.
I'm going to do some reading but any clarity around the "spool" function where
tape is concerned would be good as I'm not entirely clear in my head if it
relates to backing up directly to tape, or if you're doing D2D2T for the 2T
part?
I feel reasonable optimistic that we're on the right track if we do go with
Bacula, sounds like there are some tweaks to the hardware we have but it
doesn't sound like we'd need to literally start over, my biggest concerns are
around us having the time to absorb it all.
Thanks again - appreciate the time you took there.
Original Message
Subject: Re: [Bacula-users] Hardware Specs & Sizing for Bacula?
Local Time: February 19, 2016 10:02 pm
UTC Time: February 19, 2016 10:02 PM
From: a...@mssl.ucl.ac.uk
To: paul.hutchi...@protonmail.com
CC: bacula-users@lists.sourceforge.net
On 19/02/16 19:10, paul.hutchings wrote:
Alan thanks, I omitted that we have a Spectra LTO6 library which would be SAS
attached to the server in question but I didn't mention it as my initial query
was more about the hardware specs.
It all ties together.
The rough plan would be D2D2T and we'd probably run one of our fileservers
(linux) directly to a local directly attached small LTO6/7 library as it's not
data where we need a long retention and it feels dumb to be running it over the
network just to send it to tape to keep for a week.
You're better off centralising it. Seriously. Even if you're only keeping the
backups a few days.
The hardware we have happens to have an 800GB SSD in it by a lucky
coincidence,which I thought could be used for the Postgres database (not used
Bacula enough to know how big the database may grow)
800Gb is big enough, but is it fast enough? ("There are SSDs and there are
SSDs"),
With the kind of use it's getting you need to know the speed of garbage
collection as this is going to be the driving factor far more than trim
commands. On top of that you need to know the endurance of the drives so you
can calculate when they'll need replacing (consumer SSDs run about 1000 times
capacity, enterprise will generally run to 100 times more than that.)
By way of comparison, 2million file full backups were taking hours to insert
attributes to the database on a raid 6 6-drive spinning set. That came down to
"5 minutes" when I moved to a raid1 pair of samsung 840pro 500GB, but became
"an hour" after a while. Flushing and trimming the disks brought the speed back
down, but as the same blocks are being repeatedly written there's no trim sent
in normal operation and they're gradually slowing down again even though
they're now on a controller which supports trim commands. Whilst 840s are
fairly notorious for their GC speed they're faster than most consumer drives
and the plan is to replace them with a pair of SM843s as 500Gb isn't large
enough anyway.
Raid is a must - you really don't want to try a restore without an intact
database. This is worst -case disaster scenario material and you need to treat
the database as business-critical - which it is when things go wrong. (The
database can also function as an IDS (intrusio
[Bacula-users] Bacula fails to start after Fedora 22 -> 23 upgrade
bacula-dir -f bacula-dir: dird.c:966-0 Could not open Catalog "MyCatalog", database "bacula". bacula-dir: dird.c:971-0 Version error for database "bacula". Wanted 15, got 14 20-Feb 10:59 bacula-dir ERROR TERMINATION Please correct configuration file: bacula-dir.conf I've an idea what's behind all this this time. I had a hell of a time going from 21 to 22 because somewhere down the line the Fedora people decided to swap from MySQL to MariaDb, assuring everyone there's no problem because everything is compatible. I ended up having to build the tables manually with the kind help of the people on this list. I guess the same has happened again, we have new bacula binaries, new Mariadb binaries etc but its still the case there is no specific Mariadb database update? Please correct me if I'm wrong., and thanks for any suggestions. +-- |This was sent by bill.dam...@yahoo.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Site24x7 APM Insight: Get Deep Visibility into Application Performance APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor end-to-end web transactions and take corrective actions now Troubleshoot faster and improve end-user experience. Signup Now! http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula fails to start after Fedora 22 -> 23 upgrade
Hi You need to run scripts in /etc/bacula/scripts to update database. Maybe is necessary change some commands to MariaDB instead MySQL /etc/bacula/scripts/update_mysql_tables /etc/bacula/scripts/grant_mysql_privileges Best Regards Wanderlei 2016-02-20 9:13 GMT-02:00 bdam : > bacula-dir -f > bacula-dir: dird.c:966-0 Could not open Catalog "MyCatalog", database > "bacula". > bacula-dir: dird.c:971-0 Version error for database "bacula". Wanted 15, > got 14 > 20-Feb 10:59 bacula-dir ERROR TERMINATION > Please correct configuration file: bacula-dir.conf > > > I've an idea what's behind all this this time. I had a hell of a time > going from 21 to 22 because somewhere down the line the Fedora people > decided to swap from MySQL to MariaDb, assuring everyone there's no problem > because everything is compatible. I ended up having to build the tables > manually with the kind help of the people on this list. I guess the same > has happened again, we have new bacula binaries, new Mariadb binaries etc > but its still the case there is no specific Mariadb database update? Please > correct me if I'm wrong., and thanks for any suggestions. > > +-- > |This was sent by bill.dam...@yahoo.com via Backup Central. > |Forward SPAM to ab...@backupcentral.com. > +-- > > > > > -- > Site24x7 APM Insight: Get Deep Visibility into Application Performance > APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month > Monitor end-to-end web transactions and take corrective actions now > Troubleshoot faster and improve end-user experience. Signup Now! > http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140 > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users > -- Site24x7 APM Insight: Get Deep Visibility into Application Performance APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor end-to-end web transactions and take corrective actions now Troubleshoot faster and improve end-user experience. Signup Now! http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula fails to start after Fedora 22 -> 23 upgrade
Thanks - that was exactly it. All I needed was to run update_mysql_tables. +-- |This was sent by bill.dam...@yahoo.com via Backup Central. |Forward SPAM to ab...@backupcentral.com. +-- -- Site24x7 APM Insight: Get Deep Visibility into Application Performance APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor end-to-end web transactions and take corrective actions now Troubleshoot faster and improve end-user experience. Signup Now! http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] clarify 'with-systemd' usage?
After a bacula 7.4 build, ./configure \ --prefix=/usr/local/bacula \ --with-systemd=(any path) \ ... the .service files are created find . | grep .service$ ./platforms/systemd/bacula-dir.service ./platforms/systemd/bacula-sd.service ./platforms/systemd/bacula-fd.service but a subsequent make install does not actually install them. WHat's the purpose of the --with-systemd=(anypath) if not to install them there? also, the default systemd= value check in configure execs, SYSTEMD_UNITDIR="`systemctl show | grep UnitPath | cut -d " " -f2`" On this system systemctl show | grep UnitPath UnitPath=/etc/systemd/system /run/systemd/system /run/systemd/generator /usr/local/lib/systemd/system /usr/lib/systemd/system /lib/systemd/system and systemctl show | grep UnitPath | cut -d " " -f2 /run/systemd/system which is NOT where unit files are typically installed. rather system-installed -> /usr/lib/systemd/system user-installed -> /etc/systemd/system What's the actual directory target intended here? -- Site24x7 APM Insight: Get Deep Visibility into Application Performance APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor end-to-end web transactions and take corrective actions now Troubleshoot faster and improve end-user experience. Signup Now! http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
