[Bacula-users] Q: one job for a group of "identical" machines using the same fileset?

[Justin Case]

Hi there,

in the age of virtualization and cloud technology such as Kubernetes I would 
assume that people might have a lot of VMs that use the same setup where they 
may store container user data under the same path for each machine.

While I see that it is possible to define just one fileset to use for all these 
VMs, I seem to miss a way to define a job that is run for a group of clients 
(e.g. sequentially for each of them to not overload the VM host) for the same 
fileset. 

Is there way in Bacula to achieve this or is this a hard limitation that a need 
an individual job per each bacula-fd machine?

Just looking for clarification, before I proceed setting up a larger number of 
jobs (which is a pain, even if you can use the templating in Baculum).

Thanks and best,
 J/C



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Q: one job for a group of "identical" machines using the same fileset?

[Bill Arlofski via Bacula-users]

On 6/15/22 10:21, Justin Case wrote:

Hi there,

in the age of virtualization and cloud technology such as Kubernetes I would 
assume that people might have a lot of VMs that use the same setup where they 
may store container user data under the same path for each machine.

While I see that it is possible to define just one fileset to use for all these 
VMs, I seem to miss a way to define a job that is run for a group of clients 
(e.g. sequentially for each of them to not overload the VM host) for the same 
fileset.

Is there way in Bacula to achieve this or is this a hard limitation that a need 
an individual job per each bacula-fd machine?

Just looking for clarification, before I proceed setting up a larger number of 
jobs (which is a pain, even if you can use the templating in Baculum).

Thanks and best,
  J/C


With Bacula, it is "One Client Per Job"

So in your example, you would create a Job template, that uses a JobDefs{} 
resource containing all t
he things common to the
jobs (Fileset, Priority, Messages, Storage, Pool, etc), then for each Job, just 
use that JobDefs and only override the things
that will be different, like the Client, for example.


Best regards,
Bill


--
Bill Arlofski
w...@protonmail.com


signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Q: one job for a group of "identical" machines using the same fileset?

[dmitri maziuk]

On 2022-06-15 11:21 AM, Justin Case wrote:


in the age of virtualization and cloud technology such as Kubernetes I would 
assume that people might have a lot of VMs that use the same setup where they 
may store container user data under the same path for each machine.


This is somewhat related to your FreeNAS question: VM/container storage 
tend to be iSCSI volumes, not network shares, so they have to be backed 
up from the client. Each has to have their own bacula client and each 
client has to have a job.


ZFS will let you export its filesystems as iSCSI volumes. You can 
snapshot them, ship the snapshots away, back up the snapshots etc. I 
don't see why you couldn't do all your volumes as one job.


Dima


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Q: one job for a group of "identical" machines using the same fileset?

[Justin Case]

Thanks, found it under Director > Configure Director > JobDefs

> On 15. Jun 2022, at 18:28, Bill Arlofski via Bacula-users 
>  wrote:
> 
> On 6/15/22 10:21, Justin Case wrote:
>> Hi there,
>> 
>> in the age of virtualization and cloud technology such as Kubernetes I would 
>> assume that people might have a lot of VMs that use the same setup where 
>> they may store container user data under the same path for each machine.
>> 
>> While I see that it is possible to define just one fileset to use for all 
>> these VMs, I seem to miss a way to define a job that is run for a group of 
>> clients (e.g. sequentially for each of them to not overload the VM host) for 
>> the same fileset.
>> 
>> Is there way in Bacula to achieve this or is this a hard limitation that a 
>> need an individual job per each bacula-fd machine?
>> 
>> Just looking for clarification, before I proceed setting up a larger number 
>> of jobs (which is a pain, even if you can use the templating in Baculum).
>> 
>> Thanks and best,
>>  J/C
> 
> With Bacula, it is "One Client Per Job"
> 
> So in your example, you would create a Job template, that uses a JobDefs{} 
> resource containing all t
> he things common to the
> jobs (Fileset, Priority, Messages, Storage, Pool, etc), then for each Job, 
> just use that JobDefs and only override the things
> that will be different, like the Client, for example.
> 
> 
> Best regards,
> Bill
> 
> 
> --
> Bill Arlofski
> w...@protonmail.com
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Q: one job for a group of "identical" machines using the same fileset?

[Radosław Korzeniewski]

Hello,

śr., 15 cze 2022 o 18:22 Justin Case  napisał(a):

> Hi there,
>
> in the age of virtualization and cloud technology such as Kubernetes I
> would assume that people might have a lot of VMs that use the same setup
> where they may store container user data under the same path for each
> machine.
>

In Bacula all such technology has a dedicated plugin which handles all your
concerns very well.
For example you can backup all your VM in a single Host or Cluster with
just one job configuration.
You can even go very Kubernetes way by selecting what containers to backup
using Labels attached to containers when using the Kubernetes plugin with a
single job configuration.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Q: one job for a group of "identical" machines using the same fileset?

[Justin Case]

Good to know, I guess for commercial use.

For my private homelab commercial plugins are out of reach. Or is there such a 
plugin for free?

Best
 J/C

> On 19. Jun 2022, at 21:27, Radosław Korzeniewski  
> wrote:
> 
> Hello,
> 
> śr., 15 cze 2022 o 18:22 Justin Case  > napisał(a):
> Hi there,
> 
> in the age of virtualization and cloud technology such as Kubernetes I would 
> assume that people might have a lot of VMs that use the same setup where they 
> may store container user data under the same path for each machine.
> 
> In Bacula all such technology has a dedicated plugin which handles all your 
> concerns very well. 
> For example you can backup all your VM in a single Host or Cluster with just 
> one job configuration.
> You can even go very Kubernetes way by selecting what containers to backup 
> using Labels attached to containers when using the Kubernetes plugin with a 
> single job configuration.
> 
> best regards
> -- 
> Radosław Korzeniewski
> rados...@korzeniewski.net 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Q: one job for a group of "identical" machines using the same fileset?

[Radosław Korzeniewski]

Hello,

niedz., 19 cze 2022 o 23:29 Justin Case  napisał(a):

> Good to know, I guess for commercial use.
>
> For my private homelab commercial plugins are out of reach. Or is there
> such a plugin for free?
>

Some plugins are available with the Community version. Others are non-free,
proprietary, you need to purchase.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Q: one job for a group of "identical" machines using the same fileset?

[Justin Case]

Interesting, ist there an overview of available Community plugins, or where 
would I best start to look around?

> On 20. Jun 2022, at 10:37, Radosław Korzeniewski  
> wrote:
> 
> Hello,
> 
> niedz., 19 cze 2022 o 23:29 Justin Case  > napisał(a):
> Good to know, I guess for commercial use.
> 
> For my private homelab commercial plugins are out of reach. Or is there such 
> a plugin for free?
> 
> Some plugins are available with the Community version. Others are non-free, 
> proprietary, you need to purchase.
> 
> best regards
> -- 
> Radosław Korzeniewski
> rados...@korzeniewski.net 
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Q: one job for a group of "identical" machines using the same fileset?

[Phil Stracchino]

On 6/20/22 06:33, Justin Case wrote:
Interesting, ist there an overview of available Community plugins, or 
where would I best start to look around?


On 20. Jun 2022, at 10:37, Radosław Korzeniewski 
mailto:rados...@korzeniewski.net>> wrote:


Hello,

niedz., 19 cze 2022 o 23:29 Justin Case > napisał(a):


Good to know, I guess for commercial use.

For my private homelab commercial plugins are out of reach. Or is
there such a plugin for free?



FYI, what I do for this application is I have a JobDef for all of the 
machines that use that fileset, then a Job for each one that basically 
just specifies that set of defaults, the job name, and the client hostname.




--
  Phil Stracchino
  Babylon Communications
  ph...@caerllewys.net
  p...@co.ordinate.org
  Landline: +1.603.293.8485
  Mobile:   +1.603.998.6958


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Q: one job for a group of "identical" machines using the same fileset?

[Justin Case]

Thanks Phil,

I have implemented exactly this in the meanwhile.

Best
 J/C

> On 20. Jun 2022, at 17:08, Phil Stracchino  wrote:
> 
> On 6/20/22 06:33, Justin Case wrote:
>> Interesting, ist there an overview of available Community plugins, or where 
>> would I best start to look around?
>>> On 20. Jun 2022, at 10:37, Radosław Korzeniewski >> > wrote:
>>> 
>>> Hello,
>>> 
>>> niedz., 19 cze 2022 o 23:29 Justin Case >> > napisał(a):
>>> 
>>>Good to know, I guess for commercial use.
>>> 
>>>For my private homelab commercial plugins are out of reach. Or is
>>>there such a plugin for free?
> 
> 
> FYI, what I do for this application is I have a JobDef for all of the 
> machines that use that fileset, then a Job for each one that basically just 
> specifies that set of defaults, the job name, and the client hostname.
> 
> 
> 
> -- 
>  Phil Stracchino
>  Babylon Communications
>  ph...@caerllewys.net
>  p...@co.ordinate.org
>  Landline: +1.603.293.8485
>  Mobile:   +1.603.998.6958
> 
> 
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Q: one job for a group of "identical" machines using the same fileset?

[Radosław Korzeniewski]

Hello,

pon., 20 cze 2022 o 12:33 Justin Case  napisał(a):

> Interesting, ist there an overview of available Community plugins, or
> where would I best start to look around?
>

Check source code at bacula/src/plugins/[fd,sd,dir]/ directories.

-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users