Re: [BackupPC-users] Backup Stuff on HTTP Servers

2021-03-16 Thread Les Mikesell 
On Tue, Mar 16, 2021 at 3:46 PM Mike Weber
 wrote:
>
> No, I think rancid and oxidized are exactly what I am looking for.  I was 
> just looking at both of them.
>
> Do you know if either of them support any type of alerting or reporting?  One 
> of the key features I was looking for was notification if a config backup 
> failed.
>
> I was just looking (from the rancid wikipedia page) it looks like OpenNMS, 
> and LibreNMS use it in some manner.

It has been several years since I've used either but I think rancid
will email you about errors.   OpenNMS is very configurable and will
notify you about all kinds of things.  I used it very extensively, but
again it was several years ago - I'm retired now.

-- 
   Les Mikesell
lesmikes...@gmail.com


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] Backup Stuff on HTTP Servers

2021-03-16 Thread Mike Weber 
On Tue, Mar 16, 2021 at 4:01 PM Les Mikesell  wrote:

> On Tue, Mar 16, 2021 at 2:22 PM Mike Weber
>  wrote:
> >
> > I have some switches, with no ssh smb or sshfs
> >
> > I want to pull a config via http...
> >
> > can backuppc support http+https server pulls?
>
> If it is not worth setting up a separate backup/management system like
> rancid or oxidized
> (
> https://nsrc.org/workshops/2020/apricot/nmm/netmgmt/en/rancid/config-management-rancid.pdf
> )
> you could simply have a cron job pull copies nightly into a directory
> somewhere to be included in your other backups.   If other people edit
> them or there are frequent changes I recommend pushing them into
> subversion or cvs (perhaps editing out any timestamps inserted by the
> retrieval process so only 'real' changes will show as a new commit
> with differences) and having a viewvc wrapper to make the changes easy
> to spot.
>
> --
>Les Mikesell
>  lesmikes...@gmail.com
>
>
No, I think rancid and oxidized are exactly what I am looking for.  I was
just looking at both of them.

Do you know if either of them support any type of alerting or reporting?
One of the key features I was looking for was notification if a config
backup failed.

I was just looking (from the rancid wikipedia page) it looks like OpenNMS,
and LibreNMS use it in some manner.

Thanks for your most excellent suggestions.

Mike
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] Backup Stuff on HTTP Servers

2021-03-16 Thread Les Mikesell 
On Tue, Mar 16, 2021 at 2:22 PM Mike Weber
 wrote:
>
> I have some switches, with no ssh smb or sshfs
>
> I want to pull a config via http...
>
> can backuppc support http+https server pulls?

If it is not worth setting up a separate backup/management system like
rancid or oxidized
(https://nsrc.org/workshops/2020/apricot/nmm/netmgmt/en/rancid/config-management-rancid.pdf)
you could simply have a cron job pull copies nightly into a directory
somewhere to be included in your other backups.   If other people edit
them or there are frequent changes I recommend pushing them into
subversion or cvs (perhaps editing out any timestamps inserted by the
retrieval process so only 'real' changes will show as a new commit
with differences) and having a viewvc wrapper to make the changes easy
to spot.

-- 
   Les Mikesell
 lesmikes...@gmail.com


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

[BackupPC-users] Backup Stuff on HTTP Servers

2021-03-16 Thread Mike Weber 
I have some switches, with no ssh smb or sshfs

I want to pull a config via http...

can backuppc support http+https server pulls?

Information Systems and Technology Director
(814) 273-8440‬ - SKF - Meet With Me:  https://calendly.com/skfsupport -
Get Help:  tick...@skyking.onedesk.com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] double hop rsync

2021-03-16 Thread gregrwm 
On Tue, Mar 16, 2021 at 10:50 AM Alexander Kobel  wrote:

> Hi Greg,
> On 3/16/21 4:27 PM, gregrwm wrote:
> > On Tue, Mar 16, 2021 at 8:45 AM  backu...@kosowsky.org>> wrote:
> > gregrwm wrote at about 19:59:53 -0500 on Monday, March 15, 2021:
> >  > i'm trying to use a double hop rsync to backup a server that can
> only be
> >  > reached indirectly.  a simple test of a double hop rsync to the
> target
> >  > server seems to work:
> >  >
> >  >   #  sudo -ubackuppc rsync -PHSAXaxe"ssh -xq 192.168.128.11 ssh
> -xq"
> >  > --rsync-path=sudo\ /usr/bin/rsync 192.168.1.243:
> /var/log/BackupPC/.bashrc
> >  > /tmp
> >  > receiving incremental file list
> >  > .bashrc
> >  > 231 100%  225.59kB/s0:00:00 (xfr#1, to-chk=0/1)
> >  >   0#
> >  >
> >  > which demonstrates that the backuppc keys, sudo settings, and
> double hop
> >  > rsync all work.
> >  >
> >  > here's my double hop settings:
> >  > $Conf{RsyncClientCmd} = 'ssh -xq 192.168.128.11 ssh -xq
> 192.168.1.243 sudo
> >  > /usr/bin/rsync $argList+';
> >  > $Conf{ClientNameAlias} = '192.168.128.11';
> >
> > Why don't you try using the 'jump' host option on ssh.
> > -J 192.168.128.11
> >
> > seems like a really good idea.  so i tried:
> >
> > $Conf{RsyncClientCmd} = 'ssh -xqJ192.168.128.11 sudo /usr/bin/rsync
> $argList+';
> > $Conf{ClientNameAlias} = '192.168.1.243';
> >
> > and got:
> > Got remote protocol 1851877475
> > Fatal error (bad version): channel 0: open failed: connect failed: Name
> or service not known
> > stdio forwarding failed
> > Can't write 1298 bytes to socket
> > fileListReceive() failed
> >
> > if you've any ideas how to tweak that and try again i'm eager,
>
> any luck with the ProxyJump config option? I use this in my BackupPC
> user's ~/.ssh/config to keep the BackupPC config as clean as possible.
> See, e.g., https://wiki.gentoo.org/wiki/SSH_jump_host#Multiple_jumps
>
> Probably, in your case it would be something like
>
> Host client
> HostName192.168.1.243
> ProxyJump   192.168.1.243
>
> HTH,
> Alex
>

and the winning magic incantation is...
$Conf{RsyncClientCmd} = 'ssh -xqJ192.168.128.11 192.168.1.243  sudo
/usr/bin/rsync $argList+';
$Conf{ClientNameAlias} = '127.0.0.1';

thank you alex and @kosowsky
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] double hop rsync

2021-03-16 Thread backuppc 
Alexander Kobel wrote at about 16:50:46 +0100 on Tuesday, March 16, 2021:
 > Hi Greg,
 > 
 > On 3/16/21 4:27 PM, gregrwm wrote:
 > > On Tue, Mar 16, 2021 at 8:45 AM  > > wrote:
 > > 
 > > gregrwm wrote at about 19:59:53 -0500 on Monday, March 15, 2021:
 > >  > i'm trying to use a double hop rsync to backup a server that can 
 > > only be
 > >  > reached indirectly.  a simple test of a double hop rsync to the 
 > > target
 > >  > server seems to work:
 > >  >
 > >  >   #  sudo -ubackuppc rsync -PHSAXaxe"ssh -xq 192.168.128.11 ssh -xq"
 > >  > --rsync-path=sudo\ /usr/bin/rsync 
 > > 192.168.1.243:/var/log/BackupPC/.bashrc
 > >  > /tmp
 > >  > receiving incremental file list
 > >  > .bashrc
 > >  >             231 100%  225.59kB/s    0:00:00 (xfr#1, to-chk=0/1)
 > >  >   0#
 > >  >
 > >  > which demonstrates that the backuppc keys, sudo settings, and 
 > > double hop
 > >  > rsync all work.
 > >  >
 > >  > here's my double hop settings:
 > >  > $Conf{RsyncClientCmd} = 'ssh -xq 192.168.128.11 ssh -xq 
 > > 192.168.1.243 sudo
 > >  > /usr/bin/rsync $argList+';
 > >  > $Conf{ClientNameAlias} = '192.168.128.11';
 > > 
 > > Why don't you try using the 'jump' host option on ssh.
 > > -J 192.168.128.11
 > > 
 > > 
 > > seems like a really good idea.  so i tried:
 > > 
 > > $Conf{RsyncClientCmd} = 'ssh -xqJ192.168.128.11 sudo /usr/bin/rsync 
 > > $argList+';
 > > $Conf{ClientNameAlias} = '192.168.1.243';
 > > 
 > > and got:
 > > Got remote protocol 1851877475
 > > Fatal error (bad version): channel 0: open failed: connect failed: Name or 
 > > service not known
 > > stdio forwarding failed
 > > Can't write 1298 bytes to socket
 > > fileListReceive() failed
 > > 
 > > if you've any ideas how to tweak that and try again i'm eager,
 > 
 > any luck with the ProxyJump config option? I use this in my BackupPC user's 
 > ~/.ssh/config to keep the BackupPC config as clean as possible.
 > See, e.g., https://wiki.gentoo.org/wiki/SSH_jump_host#Multiple_jumps
 > 
 > Probably, in your case it would be something like
 > 
 > Host client
 >  HostName192.168.1.243
 >  ProxyJump   192.168.1.243
 > 
 > 
 > HTH,
 > Alex

Of course as per the man page "This [-J] is a shortcut to specify a
ProxyJump configuration directive."

You may need a '-t' to force a pseudo-terminal allocation.
Also, make sure you have access to the right identity file.
Proxy jumps are really powerful... suggest you play with them first
outside of BackupPC and then seek help after you have gotten the hang
of it.


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] double hop rsync

2021-03-16 Thread Alexander Kobel 
Hi Greg,

On 3/16/21 4:27 PM, gregrwm wrote:
> On Tue, Mar 16, 2021 at 8:45 AM  > wrote:
> 
> gregrwm wrote at about 19:59:53 -0500 on Monday, March 15, 2021:
>  > i'm trying to use a double hop rsync to backup a server that can only 
> be
>  > reached indirectly.  a simple test of a double hop rsync to the target
>  > server seems to work:
>  >
>  >   #  sudo -ubackuppc rsync -PHSAXaxe"ssh -xq 192.168.128.11 ssh -xq"
>  > --rsync-path=sudo\ /usr/bin/rsync 
> 192.168.1.243:/var/log/BackupPC/.bashrc
>  > /tmp
>  > receiving incremental file list
>  > .bashrc
>  >             231 100%  225.59kB/s    0:00:00 (xfr#1, to-chk=0/1)
>  >   0#
>  >
>  > which demonstrates that the backuppc keys, sudo settings, and double 
> hop
>  > rsync all work.
>  >
>  > here's my double hop settings:
>  > $Conf{RsyncClientCmd} = 'ssh -xq 192.168.128.11 ssh -xq 192.168.1.243 
> sudo
>  > /usr/bin/rsync $argList+';
>  > $Conf{ClientNameAlias} = '192.168.128.11';
> 
> Why don't you try using the 'jump' host option on ssh.
> -J 192.168.128.11
> 
> 
> seems like a really good idea.  so i tried:
> 
> $Conf{RsyncClientCmd} = 'ssh -xqJ192.168.128.11 sudo /usr/bin/rsync 
> $argList+';
> $Conf{ClientNameAlias} = '192.168.1.243';
> 
> and got:
> Got remote protocol 1851877475
> Fatal error (bad version): channel 0: open failed: connect failed: Name or 
> service not known
> stdio forwarding failed
> Can't write 1298 bytes to socket
> fileListReceive() failed
> 
> if you've any ideas how to tweak that and try again i'm eager,

any luck with the ProxyJump config option? I use this in my BackupPC user's 
~/.ssh/config to keep the BackupPC config as clean as possible.
See, e.g., https://wiki.gentoo.org/wiki/SSH_jump_host#Multiple_jumps

Probably, in your case it would be something like

Host client
HostName192.168.1.243
ProxyJump   192.168.1.243


HTH,
Alex

> thank you,
> greg
> 
> 
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:https://github.com/backuppc/backuppc/wiki
> Project: https://backuppc.github.io/backuppc/
> 



smime.p7s
Description: S/MIME Cryptographic Signature
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] double hop rsync

2021-03-16 Thread gregrwm 
On Tue, Mar 16, 2021 at 8:45 AM  wrote:

> gregrwm wrote at about 19:59:53 -0500 on Monday, March 15, 2021:
>  > i'm trying to use a double hop rsync to backup a server that can only be
>  > reached indirectly.  a simple test of a double hop rsync to the target
>  > server seems to work:
>  >
>  >   #  sudo -ubackuppc rsync -PHSAXaxe"ssh -xq 192.168.128.11 ssh -xq"
>  > --rsync-path=sudo\ /usr/bin/rsync 192.168.1.243:
> /var/log/BackupPC/.bashrc
>  > /tmp
>  > receiving incremental file list
>  > .bashrc
>  > 231 100%  225.59kB/s0:00:00 (xfr#1, to-chk=0/1)
>  >   0#
>  >
>  > which demonstrates that the backuppc keys, sudo settings, and double hop
>  > rsync all work.
>  >
>  > here's my double hop settings:
>  > $Conf{RsyncClientCmd} = 'ssh -xq 192.168.128.11 ssh -xq 192.168.1.243
> sudo
>  > /usr/bin/rsync $argList+';
>  > $Conf{ClientNameAlias} = '192.168.128.11';
>
> Why don't you try using the 'jump' host option on ssh.
> -J 192.168.128.11
>

seems like a really good idea.  so i tried:

$Conf{RsyncClientCmd} = 'ssh -xqJ192.168.128.11 sudo /usr/bin/rsync
$argList+';
$Conf{ClientNameAlias} = '192.168.1.243';

and got:
Got remote protocol 1851877475
Fatal error (bad version): channel 0: open failed: connect failed: Name or
service not known
stdio forwarding failed
Can't write 1298 bytes to socket
fileListReceive() failed

if you've any ideas how to tweak that and try again i'm eager,
thank you,
greg
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] double hop rsync

2021-03-16 Thread backuppc 
gregrwm wrote at about 19:59:53 -0500 on Monday, March 15, 2021:
 > i'm trying to use a double hop rsync to backup a server that can only be
 > reached indirectly.  a simple test of a double hop rsync to the target
 > server seems to work:
 > 
 >   #  sudo -ubackuppc rsync -PHSAXaxe"ssh -xq 192.168.128.11 ssh -xq"
 > --rsync-path=sudo\ /usr/bin/rsync 192.168.1.243:/var/log/BackupPC/.bashrc
 > /tmp
 > receiving incremental file list
 > .bashrc
 > 231 100%  225.59kB/s0:00:00 (xfr#1, to-chk=0/1)
 >   0#
 > 
 > which demonstrates that the backuppc keys, sudo settings, and double hop
 > rsync all work.
 > 
 > here's my double hop settings:
 > $Conf{RsyncClientCmd} = 'ssh -xq 192.168.128.11 ssh -xq 192.168.1.243 sudo
 > /usr/bin/rsync $argList+';
 > $Conf{ClientNameAlias} = '192.168.128.11';
 > 

Why don't you try using the 'jump' host option on ssh.
-J 192.168.128.11



___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] what's the best way to backup qcow2 files (on centos8)?

2021-03-16 Thread gregrwm 
On Mon, Mar 15, 2021 at 7:19 PM gregrwm  wrote:

> problem:  blockcommit only works if the guest is running.
>
> so, not a problem with backuppc, but a problem with how to use it.
>
> currently i'm using:
> DumpPreShareCmd:
> virsh snapshot-create-as   --atomic --no-metadata --disk-only
> --diskspec=
> mkdir -p /mnt/point
> guestmount -iroallow_root -a /mnt/point
>
> DumpPostShareCmd:
> guestunmount /mnt/point
> virsh blockcommit   --active --pivot --delete
>
> but blockcommit only works if the guest is running.
>
> is there an approach that works, whether the guest is running, stopped, or
> stops or starts during the backup?
>

methods i'm not considering:
just copy the qcow2 files.
copy files out from inside a running vm.
stop the vm and then copy files.

"QCOW2 backing files & overlays"
(https://kashyapc.fedorapeople.org/virt/lc-2012/snapshots-handout.html)
...discusses internal snapshots, which to me raises the question, how might
i mount (or guestmount) an internal snapshot so i can copy files out of it?
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/