Re: [bareos-users] Backup to multiple removable usb attached disks

2018-02-21 Thread Stefan Klatt 
Hello Michael,

it's easy to implement, you need to see two sides, autofs and bareos:

With autofs a connected hard disk auto mounts if a program tries to
access it and dismounts automatically a short time after no program
access it. The last was a little tricky because it need to be really
short (depends on the system).

Each hard disk is labelled with a unique name like hd1, hd2 (easier
to read and  remember then a id) and use a mount point like:

/mnt/hd1
/mnt/hd2
/mnt/hd3
/mnt/hd4


On bareos I use two pools for each hard disk: full and incremental
For this I have 8 pools for 4 hard disks and 4 job definitions per file
daemon, each for a week (and hard disk).

If I forgot to connect the correct hard disk at the moment I get an
email with an error and bareos retries it the next night. This can be
handled with automatically retries if you want. For me it's good.

This combination works really fast on Centos 7.4 running under ESXi 6.0
U2 with passed through USB3 ports (not the complete USB controller!). I
found that the performance depends mostly on the USB hard disk
controller. For this I use portable WD USB3 4TB hard disks (6TB work
well too here).

Additionally lvm snapshots are really handy for backup large storages.

I thought a little bit about your idea to use a pool of hard disks and
email (SMS?) requests if a hard disk is not connected.
What about a job which use a script to check the hard disks (or what
ever you want) and send you an email/SMS/ if a hard disk is not
connected and starts the backup job if all hard disks are connected?

Other point is that multiple drives can be used with there storage
definitions at one pool. But this I didn't use before.

These are different pools for full and incremental... I saw it too late,
but both are on the same hard disk (my comment about different pools
for full and incremental backups).

Regards

Stefan


Am 21.02.2018 um 10:54 schrieb Michael Thalmann:
> That sounds interesting and promising! I started to think about it
> when I read the bacula Book and there vchanger is used albeit for a
> different purpose, but it looked like it can be used for my
> requirements, too.
>
> Can you explain a liitle bit more in detail how/what you are doing?
> ANy starting point is helpful! In exchange, I can write up a little howto?
>
>
>
>
>> Am 19.02.2018 um 22:59 schrieb Stefan Klatt
>> mailto:stefan.kl...@cac-netzwerk.de>>:
>>
>> Hi Micha,
>>
>> to backup on USB harddisks  I use a mix of bareos, autofs and labeled
>> USB3 harddisks on VMWare.
>> In the past I didn't used different pools for full and incremental
>> backups and can't say if this work.
>>
>> Regards
>>
>> Stefan
>>
>> Am 08.02.2018 um 09:31 schrieb Micha:
>>> Dear list,
>>>
>>> I am looking for a backup solution which is able to use multiple USB 
>>> connected disks as backup destination.
>>> Is this possible with bareos? I have read that backup to a disk pool is 
>>> possible, but I want to schedule a full backup which might span 2 or more 
>>> USB drives. Once this completes, following incremental jobs should continue 
>>> on another USB drive. Also I would like to remove the disks once the backup 
>>> is done to be protected from whatever damage can be done to the main system.
>>>
>>> In an ideal world, for a restore I would connect the disks from the full 
>>> backup plus the disk(s) from incremental and bareos would figure out that 
>>> all required drives are connected and available. If not, I would see 
>>> requests for the drives required as it would request a specific tape.
>>>
>>> Is this possible at all, maybe with the help of vchanger?
>>>
>>
>> -- 
>> *CaC, Computer and Communication*
>> Inhaber Stefan Klatt
>> End-2-End Senior Network Consultant
>> CISSP / CISM / ISO27001 Lead Implementer / TOGAF9
>> Triftstrasse 9
>> 60528 Frankfurt
>> Germany
>> USt-IdNr.: DE260461592
>>
>> Tel.: +49-(0)172-6807809
>> Tel.: +49-(0)69-67808-900
>> Fax: +49-(0)69-67808-837
>> Email: stefan.kl...@cac-netzwerk.de
>> Profil: http://www.cac-netzwerk.de/profil
>>
>> -- 
>> You received this message because you are subscribed to the Google
>> Groups "bareos-users" group.
>> To unsubscribe from this group and stop receiving emails from it,
>> send an email to bareos-users+unsubscr...@googlegroups.com
>> .
>> To post to this group, send email to bareos-users@googlegroups.com
>> .
>> For more options, visit https://groups.google.com/d/optout.
>
> -- 
> You received this message because you are subscribed to the Google
> Groups "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to bareos-users+unsubscr...@googlegroups.com
> .
> To post to this group, send email to bareos-users@googlegroups.com
> .
> For more options, visit https://groups.google.com/d/optout.

-- 
*CaC, Comput

Re: [bareos-users] Backup to multiple removable usb attached disks

2018-02-21 Thread Michael Thalmann 
That sounds interesting and promising! I started to think about it when I read 
the bacula Book and there vchanger is used albeit for a different purpose, but 
it looked like it can be used for my requirements, too.

Can you explain a liitle bit more in detail how/what you are doing? ANy 
starting point is helpful! In exchange, I can write up a little howto?




> Am 19.02.2018 um 22:59 schrieb Stefan Klatt :
> 
> Hi Micha,
> 
> to backup on USB harddisks  I use a mix of bareos, autofs and labeled USB3 
> harddisks on VMWare.
> In the past I didn't used different pools for full and incremental backups 
> and can't say if this work.
> 
> Regards
> 
> Stefan
> 
> Am 08.02.2018 um 09:31 schrieb Micha:
>> Dear list,
>> 
>> I am looking for a backup solution which is able to use multiple USB 
>> connected disks as backup destination.
>> Is this possible with bareos? I have read that backup to a disk pool is 
>> possible, but I want to schedule a full backup which might span 2 or more 
>> USB drives. Once this completes, following incremental jobs should continue 
>> on another USB drive. Also I would like to remove the disks once the backup 
>> is done to be protected from whatever damage can be done to the main system.
>> 
>> In an ideal world, for a restore I would connect the disks from the full 
>> backup plus the disk(s) from incremental and bareos would figure out that 
>> all required drives are connected and available. If not, I would see 
>> requests for the drives required as it would request a specific tape.
>> 
>> Is this possible at all, maybe with the help of vchanger?
>> 
> 
> -- 
> CaC, Computer and Communication
> Inhaber Stefan Klatt
> End-2-End Senior Network Consultant
> CISSP / CISM / ISO27001 Lead Implementer / TOGAF9
> Triftstrasse 9
> 60528 Frankfurt
> Germany
> USt-IdNr.: DE260461592
> 
> Tel.: +49-(0)172-6807809
> Tel.: +49-(0)69-67808-900
> Fax: +49-(0)69-67808-837
> Email: stefan.kl...@cac-netzwerk.de 
> Profil: http://www.cac-netzwerk.de/profil 
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to bareos-users+unsubscr...@googlegroups.com 
> .
> To post to this group, send email to bareos-users@googlegroups.com 
> .
> For more options, visit https://groups.google.com/d/optout 
> .

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [bareos-users] Backup to multiple removable usb attached disks

2018-02-19 Thread Stefan Klatt 
Hi Micha,

to backup on USB harddisks  I use a mix of bareos, autofs and labeled
USB3 harddisks on VMWare.
In the past I didn't used different pools for full and incremental
backups and can't say if this work.

Regards

Stefan

Am 08.02.2018 um 09:31 schrieb Micha:
> Dear list,
>
> I am looking for a backup solution which is able to use multiple USB 
> connected disks as backup destination.
> Is this possible with bareos? I have read that backup to a disk pool is 
> possible, but I want to schedule a full backup which might span 2 or more USB 
> drives. Once this completes, following incremental jobs should continue on 
> another USB drive. Also I would like to remove the disks once the backup is 
> done to be protected from whatever damage can be done to the main system.
>
> In an ideal world, for a restore I would connect the disks from the full 
> backup plus the disk(s) from incremental and bareos would figure out that all 
> required drives are connected and available. If not, I would see requests for 
> the drives required as it would request a specific tape.
>
> Is this possible at all, maybe with the help of vchanger?
>

-- 
*CaC, Computer and Communication*
Inhaber Stefan Klatt
End-2-End Senior Network Consultant
CISSP / CISM / ISO27001 Lead Implementer / TOGAF9
Triftstrasse 9
60528 Frankfurt
Germany
USt-IdNr.: DE260461592

Tel.: +49-(0)172-6807809
Tel.: +49-(0)69-67808-900
Fax: +49-(0)69-67808-837
Email: stefan.kl...@cac-netzwerk.de
Profil: http://www.cac-netzwerk.de/profil

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


smime.p7s
Description: S/MIME Cryptographic Signature

Re: [bareos-users] Backup to multiple removable usb attached disks

2018-02-08 Thread Micha 
Well that might be your opinion - my experience is much more diversified. Don't 
assume the same solution fits everywhere. 

But this is not the question here - I just wanted to know if Bareos is usable 
in a removable disk scenario. The data to backup is around 12TB.

PS:
I know environments where tape is an excellent choice, and I have seen 
environments where tapes failed miserably while hard drives worked extremely 
reliable. 
It is just not black and white in real life.




> Am 08.02.2018 um 16:11 schrieb Tony Albers :
> 
> Don't ever base your disaster recovery system on something as 
> volatile/unstable as USB disks. That's just wrong.
> 
> 
> 
> On Feb 8, 2018 09:31, "Micha" mailto:m...@s3u.de>> wrote:
> Dear list,
> 
> I am looking for a backup solution which is able to use multiple USB 
> connected disks as backup destination.
> Is this possible with bareos? I have read that backup to a disk pool is 
> possible, but I want to schedule a full backup which might span 2 or more USB 
> drives. Once this completes, following incremental jobs should continue on 
> another USB drive. Also I would like to remove the disks once the backup is 
> done to be protected from whatever damage can be done to the main system.
> 
> In an ideal world, for a restore I would connect the disks from the full 
> backup plus the disk(s) from incremental and bareos would figure out that all 
> required drives are connected and available. If not, I would see requests for 
> the drives required as it would request a specific tape.
> 
> Is this possible at all, maybe with the help of vchanger?
> 
> --
> You received this message because you are subscribed to the Google Groups 
> "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to bareos-users+unsubscr...@googlegroups.com 
> .
> To post to this group, send email to bareos-users@googlegroups.com 
> .
> For more options, visit https://groups.google.com/d/optout 
> .
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to bareos-users+unsubscr...@googlegroups.com 
> .
> To post to this group, send email to bareos-users@googlegroups.com 
> .
> For more options, visit https://groups.google.com/d/optout 
> .

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [bareos-users] Backup to multiple removable usb attached disks

2018-02-08 Thread Tony Albers 
Don't ever base your disaster recovery system on something as
volatile/unstable as USB disks. That's just wrong.



On Feb 8, 2018 09:31, "Micha"  wrote:

> Dear list,
>
> I am looking for a backup solution which is able to use multiple USB
> connected disks as backup destination.
> Is this possible with bareos? I have read that backup to a disk pool is
> possible, but I want to schedule a full backup which might span 2 or more
> USB drives. Once this completes, following incremental jobs should continue
> on another USB drive. Also I would like to remove the disks once the backup
> is done to be protected from whatever damage can be done to the main system.
>
> In an ideal world, for a restore I would connect the disks from the full
> backup plus the disk(s) from incremental and bareos would figure out that
> all required drives are connected and available. If not, I would see
> requests for the drives required as it would request a specific tape.
>
> Is this possible at all, maybe with the help of vchanger?
>
> --
> You received this message because you are subscribed to the Google Groups
> "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to bareos-users+unsubscr...@googlegroups.com.
> To post to this group, send email to bareos-users@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[bareos-users] Backup to multiple removable usb attached disks

2018-02-08 Thread Micha 
Dear list,

I am looking for a backup solution which is able to use multiple USB connected 
disks as backup destination.
Is this possible with bareos? I have read that backup to a disk pool is 
possible, but I want to schedule a full backup which might span 2 or more USB 
drives. Once this completes, following incremental jobs should continue on 
another USB drive. Also I would like to remove the disks once the backup is 
done to be protected from whatever damage can be done to the main system.

In an ideal world, for a restore I would connect the disks from the full backup 
plus the disk(s) from incremental and bareos would figure out that all required 
drives are connected and available. If not, I would see requests for the drives 
required as it would request a specific tape.

Is this possible at all, maybe with the help of vchanger?

-- 
You received this message because you are subscribed to the Google Groups 
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to bareos-users+unsubscr...@googlegroups.com.
To post to this group, send email to bareos-users@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.