Re: [Bacula-users] Questions re installing on Debian 11 Bullseye

[Vaughan Wickham]

Hello,

I’ve attempted to follow the documentation below (thanks to Davide for sharing)

https://bacula.org/whitepapers/CommunityInstallationGuide.pdf

However, step 4.2 (Import the GPG key) fails due to apt-key being deprecated. I 
also understand that there are potentially issues with the trusted.gpg.d 
replacement.

I was wondering, if it might be possible to download the binaries from the 
CommunityInstall site and then install them manually?

Regards,
Vaughan
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Running backup job without file records in catalog

[Bill Arlofski via Bacula-users]

On 10/4/23 06:28, Yateen Shaligram Bhagat (Nokia) wrote:

We don’t need the File Records in backup because :

 1. Each of our production servers (hundreds of them) being backed up, has 
number of files in the range of hundred-thousands.
 2. With Catalog Files = Yes (default), the database (PostGreSQL)  hogs the 
CPUs on the host, with say 100 concurrent weekly
Full backup jobs, putting a lot of stress  on the server.
 3. Last but not the least, there is hardly a need to precisely locate a single 
file during restoration. The restore is
always in bulk at top dir level.

With Catalog Files = No (in pool resource def) , we have already seen a big 
performance enhancement on  the DB server.

Bu there is a flip side, Virtual Full backup can no longer be achieved.

-Yateen S Bhagat



Hello Yateen,

Another thing to know is that you also cannot do "Accurate" mode backups, nor Verify, nor Copy, nor Migration Jobs if you do 
not have files in the catalog.



Best regards,
Bill

--
Bill Arlofski
w...@protonmail.com



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Running backup job without file records in catalog

[Yateen Shaligram Bhagat (Nokia)]

We don't need the File Records in backup because :


  1.  Each of our production servers (hundreds of them) being backed up, has 
number of files in the range of hundred-thousands.
  2.  With Catalog Files = Yes (default), the database (PostGreSQL)  hogs the 
CPUs on the host, with say 100 concurrent weekly Full backup jobs, putting a 
lot of stress  on the server.
  3.  Last but not the least, there is hardly a need to precisely locate a 
single file during restoration. The restore is always in bulk at top dir level.


With Catalog Files = No (in pool resource def) , we have already seen a big 
performance enhancement on  the DB server.
Bu there is a flip side, Virtual Full backup can no longer be achieved.

-Yateen S Bhagat





From: Dan Langille 
Sent: Wednesday, October 4, 2023 12:43 AM
To: fk+bacula--- via Bacula-users 
Subject: Re: [Bacula-users] Running backup job without file records in catalog


CAUTION: This is an external email. Please be very careful when clicking links 
or opening attachments. See the URL nok.it/ext for additional information.


On Thu, Sep 28, 2023, at 6:17 AM, Yateen Shaligram Bhagat (Nokia) wrote:

Hi All,



I would like to know if we can define a backup job (real or virtual) that DOES 
NOT put the file records in the catalog at all.



Why?

Whenever an unusual question arises, it helps to explain the background, the 
goal, the objective, etc.

Thanks.

--
  Dan Langille
  d...@langille.org


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Questions re installing on Debian 11 Bullseye

[Peter Milesson via Bacula-users]

Hi folks,

Installing on Debian 11 is bound to fail, as the documentation and 
reality are not in sync. I had this problem yesterday, and spent quite 
some time figuring out what was wrong. About the package manager entry 
under /etc/apt/sources.list.d, the document mentioned below states:


"# Bacula Community
deb https://www.bacula.org/packages/@access-key@/debs/@bacula-version@ 
@debian-version@ main"


But a working entry should be (for amd64 architecture):

https://www.bacula.org/packages/@access-key@/debs/@bacula-version@/@debian-version@/amd64 
@debian-version@ main


Best regards,

Peter

On 04.10.2023 8:31, Davide F. via Bacula-users wrote:

Hi,

There’s a specific documentation for rpm and deb Bacula installation.

https://bacula.org/whitepapers/CommunityInstallationGuide.pdf

Hope it helps

Davide

On Wed, 4 Oct 2023 at 07:36 Vaughan Wickham  wrote:

Hello,

I’m trying to the follow the installation / setup instructions
here
https://www.bacula.org/13.0.x-manuals/en/main/Installing_Bacula.html

Unfortunately, I’m finding these docs hard to follow.

The ‘Installing Bacula’ section appears to focus primarily on
building Bacula from the source.

However, in my case, I have downloaded the Debian 11 binaries, so
I think this section is largely irrelevant in my scenario.

I have downloaded and installed the following packages:

sudo dpkg -i bacula-common_13.0.3-1_amd64.deb

sudo dpkg -i bacula-client_13.0.3-1_amd64.deb

sudo dpkg -i bacula-console_13.0.3-1_amd64.deb

sudo apt-get install dbconfig-common

sudo apt-get install dbconfig-pgsql

sudo apt-get install postgresql-contrib

sudo dpkg -i bacula-postgresql_13.0.3-1_amd64.deb

During the postgresql installation a menu appeared, and I was
prompted to perform some high-level database configuration.

So, to the best of my knowledge I have installed Bacula OK and
basic PostgreSQL configuration is done.

In the tutorial section
https://www.bacula.org/13.0.x-manuals/en/main/Brief_Tutorial.html

The first step is:

 1. cd 

But I don’t have an install directory, as I downloaded all of the
binaries. So, where should I be starting from?

Step 2. Start the Database.

According to systemctl: PostgreSQL service is active.

Step 3. Start the Daemons with ./bacula start

I get no such file or directory.

The files / folders that I do have are:

/opt/bacula

/opt/bacula/scripts/bacula

/var/log/bacula

/var/lib/bacula

Would appreciate some suggestions on what to do / try next.

Also, is there by chance another installation guide / tutorial
that is perhaps easier to follow than this guide. I’ve had a look
on Google and YouTube and while I have found some other resources,
they don’t seem to be the “answer”. So, for now, I’ve been
persisting with this guide.

Thanks

Regards,

Vaughan

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Adding missing foreign keys to PostgreSQL - avoiding dbcheck

[Eric Bollengier via Bacula-users]

Hello Dan,

On 10/3/23 21:01, Dan Langille wrote:

On Tue, Oct 3, 2023, at 1:45 PM, Eric Bollengier via Bacula-users wrote:

Hello Dan,

On 9/30/23 15:54, Dan Langille wrote:
Basically, each time you insert something, you need to query the other tables to
check the existence or not of records. The checks for the existence of the
records is already done at the bacula level one time per job, no real need to do
it one time per insertion/update/delete.


Is that one-time-per-job check done via a SELECT on the database? I should 
explain analyze that one too and see if we can optimize that.


Look the code, we get/create the fileset record, pool record, client, device,
... records when we start a job or load the configuration.

For Path, the query itself ensures that we have the proper records, it's
builtin.


For example, one index I have been using this index for years. I find it 
referenced[1] in the the 5.x documentation, but it is not part of the catalog 
creation.

  "file_jobid_idx" btree (jobid)

This index vastly improves the construction of the files, often going from 
hours to seconds. I don't recall when that index was added here, but building 
trees has never been an issue here.


This index is great, but it uses GB of space and it has a cost during the
insertion of the attributes. PostgreSQL can use the composed index on JobId,
PathId instead to locate records, so you may add it back if you want, but it's
not mandatory.


How many GB? Do we know? We can easily find out too.

bacula=# select pg_table_size('file_jobid_idx');
  pg_table_size
---
37937438720
(1 row)

That's about 40GB.  I'll check the explain analyse and see how things go and 
come up with cost. Right now, we have no data.

Some might say: if the cost > 0 it's not worth it. However, it is worth it, 
IMO. Databases are much better at enforcing relational integrity than code is. 
It's what they do.


When Marc Cousin and I have worked on the Batch insert procedures, we have
tested all these scenario including the FKEY, it was back in 2006 maybe.
PostgreSQL has done a lot of progress since and SSD are replacing spinning disks
for example, so it might be different, hard to say without a deep analysis with
a large data set.

Our complete analysis and wide range of tests that we did for a couple of months
ended with the code we have today.

Best Regards,
Eric


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Questions re installing on Debian 11 Bullseye

[Pedro Oliveira]

Hi  Vaughan

Heitor from Bacula Latam has a script that automates the Bacula 
Instalation process.


Please have a look at

https://www.bacula.lat/community/bacula-community-9-x-official-packages-installation-script/?lang=en

Best Regards

Pedro

Às 06:18 de 04/10/23, Vaughan Wickham escreveu:


Hello,

I’m trying to the follow the installation / setup instructions here 
https://www.bacula.org/13.0.x-manuals/en/main/Installing_Bacula.html


Unfortunately, I’m finding these docs hard to follow.

The ‘Installing Bacula’ section appears to focus primarily on building 
Bacula from the source.


However, in my case, I have downloaded the Debian 11 binaries, so I 
think this section is largely irrelevant in my scenario.


I have downloaded and installed the following packages:

sudo dpkg -i bacula-common_13.0.3-1_amd64.deb

sudo dpkg -i bacula-client_13.0.3-1_amd64.deb

sudo dpkg -i bacula-console_13.0.3-1_amd64.deb

sudo apt-get install dbconfig-common

sudo apt-get install dbconfig-pgsql

sudo apt-get install postgresql-contrib

sudo dpkg -i bacula-postgresql_13.0.3-1_amd64.deb

During the postgresql installation a menu appeared, and I was prompted 
to perform some high-level database configuration.


So, to the best of my knowledge I have installed Bacula OK and basic 
PostgreSQL configuration is done.


In the tutorial section 
https://www.bacula.org/13.0.x-manuals/en/main/Brief_Tutorial.html


The first step is:

 1. cd 

But I don’t have an install directory, as I downloaded all of the 
binaries. So, where should I be starting from?


Step 2. Start the Database.

According to systemctl: PostgreSQL service is active.

Step 3. Start the Daemons with ./bacula start

I get no such file or directory.

The files / folders that I do have are:

/opt/bacula

/opt/bacula/scripts/bacula

/var/log/bacula

/var/lib/bacula

Would appreciate some suggestions on what to do / try next.

Also, is there by chance another installation guide / tutorial that is 
perhaps easier to follow than this guide. I’ve had a look on Google 
and YouTube and while I have found some other resources, they don’t 
seem to be the “answer”. So, for now, I’ve been persisting with this 
guide.


Thanks

Regards,

Vaughan



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Questions re installing on Debian 11 Bullseye

[Davide F. via Bacula-users]

Hi,

There’s a specific documentation for rpm and deb Bacula installation.

https://bacula.org/whitepapers/CommunityInstallationGuide.pdf

Hope it helps

Davide

On Wed, 4 Oct 2023 at 07:36 Vaughan Wickham  wrote:

> Hello,
>
>
>
> I’m trying to the follow the installation / setup instructions here
> https://www.bacula.org/13.0.x-manuals/en/main/Installing_Bacula.html
>
>
>
> Unfortunately, I’m finding these docs hard to follow.
>
>
>
> The ‘Installing Bacula’ section appears to focus primarily on building
> Bacula from the source.
>
>
>
> However, in my case, I have downloaded the Debian 11 binaries, so I think
> this section is largely irrelevant in my scenario.
>
>
>
> I have downloaded and installed the following packages:
>
>
>
> sudo dpkg -i bacula-common_13.0.3-1_amd64.deb
>
>
>
> sudo dpkg -i bacula-client_13.0.3-1_amd64.deb
>
>
>
> sudo dpkg -i bacula-console_13.0.3-1_amd64.deb
>
>
>
> sudo apt-get install dbconfig-common
>
> sudo apt-get install dbconfig-pgsql
>
> sudo apt-get install postgresql-contrib
>
>
>
> sudo dpkg -i bacula-postgresql_13.0.3-1_amd64.deb
>
>
>
> During the postgresql installation a menu appeared, and I was prompted to
> perform some high-level database configuration.
>
>
>
> So, to the best of my knowledge I have installed Bacula OK and basic
> PostgreSQL configuration is done.
>
>
>
> In the tutorial section
> https://www.bacula.org/13.0.x-manuals/en/main/Brief_Tutorial.html
>
>
>
> The first step is:
>
>1. cd 
>
> But I don’t have an install directory, as I downloaded all of the
> binaries. So, where should I be starting from?
>
>
>
> Step 2. Start the Database.
>
>
>
> According to systemctl: PostgreSQL service is active.
>
>
>
> Step 3. Start the Daemons with ./bacula start
>
> I get no such file or directory.
>
>
>
> The files / folders that I do have are:
>
> /opt/bacula
>
> /opt/bacula/scripts/bacula
>
> /var/log/bacula
>
> /var/lib/bacula
>
>
>
> Would appreciate some suggestions on what to do / try next.
>
>
>
> Also, is there by chance another installation guide / tutorial that is
> perhaps easier to follow than this guide. I’ve had a look on Google and
> YouTube and while I have found some other resources, they don’t seem to be
> the “answer”. So, for now, I’ve been persisting with this guide.
>
>
>
> Thanks
>
>
>
> Regards,
>
> Vaughan
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Running backup job without file records in catalog

[Yateen Shaligram Bhagat (Nokia)]

Hi all,

I found an answer to this issue, Ana Emília M. Arruda had already replied to 
this question back in Jan 2023, I had missed that email earlier.

The trick is to have "Catalog Files = No" in client config file.

However I notice that with this setting, the Virtual Full backup can not 
happen, due to file records missing.

Thanks

Yateen S Bhagat
From: Yateen Shaligram Bhagat (Nokia) 
Sent: Thursday, September 28, 2023 3:47 PM
To: bacula-users@lists.sourceforge.net
Subject: Running backup job without file records in catalog

Hi All,

I would like to know if we can define a backup job (real or virtual) that DOES 
NOT put the file records in the catalog at all.

Thanks,

Yateen Bhagat


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users