Re: [BackupPC-users] Feature Request

2014-08-28 Thread Les Mikesell
On Thu, Aug 28, 2014 at 3:49 PM,   wrote:
> >  >
>  > Aren't $client and $host set by the time you need them (as documented
>  > to be used in $Conf(RsyncArgs}, $conf{DumpPreUserCmd}, etc.)?
>  >
> You are correct that at the time the config file is sourced, the
> variable $host (not $HOST) has not yet been set.

$host wouldn't be set until after $ClientNameAlias has been processed,
but $client might be.

--
  Les Mikesell
lesmiks...@gmail.com

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Queue Order / Queue Pools

2014-08-28 Thread Adam Goryachev
On 29/08/14 01:36, Carl Cravens wrote:
> I can't complete all the backups in a day with a maxbackups of 1.  It's 
> unreasonable to micromanage the blackout periods for 70+ hosts to keep 
> certain ones from overlapping.
>
> I've coped with the problem, but it's something that an 
> only-one-host-at-a-time-from-this-group feature would make a lot easier to 
> deal with.

This has come up a few times, and I've just had a thought (a dangerous 
prospect) but in combination with the other thread about variables in 
config files, it might work.

Can the perl code embedded in the host config files create (read and 
modify) a global variable which will be available to another hosts 
config file.

In other words, something like this in both of host1 and host2 to make 
sure that these two don't run at the same time:
if(++$myGroup > 1)
{
 $myGroup--;
  exit 1;
}

Failing that, I suppose you would need to resort to reading/writing the 
value into a file, which could be as simple as (in sh script because I 
can't be bothered to get correct syntax for perl):
if [ -f /somedir/myGroup ]
then
 exit 1
else
 echo $pid >> /somedir/myGroup
# Could ensure that the entire content of myGroup is the pid (ie, 
another host didn't add it's pid in a race condition)
fi

Also need to ensure that exit 1 is even a valid method to say don't 
backup now, another option might be to set the pingcmd to /bin/false or 
similar.

Regards,
Adam

> On 08/28/2014 09:45 AM, Les Mikesell wrote:
>> On Thu, Aug 28, 2014 at 8:11 AM, Carl Cravens  wrote:
>>> This is a feature I've wanted as well.  I have virtual machines running on 
>>> multiple hypervisors, and I'd prefer to only run one backup per hypervisor 
>>> at a time.  If I could do that, I could get away with backups during the 
>>> day... but if I back up the main file server and the groupware server at 
>>> the same time, tech support starts getting calls about things being slow.
>>>
>> Have you tried taking MaxBackups down to 1 to see if backups will
>> still complete in the available time?   Or skewing the blackout
>> periods for the host and guest systems?
>>


-- 
Adam Goryachev Website Managers www.websitemanagers.com.au

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Feature Request

2014-08-28 Thread backuppc
Les Mikesell wrote at about 13:53:04 -0500 on Thursday, August 28, 2014:
 > On Thu, Aug 28, 2014 at 12:18 PM, Andreas Schnederle-Wagner -
 > Futureweb.at  wrote:
 > >
 > >> Andreas Schnederle-Wagner - Futureweb.at wrote at about 15:41:11 + on 
 > >> Thursday, August 28, 2014:
 > >>  > The Reason we did this ist o avoid custom Config Files for each Host.
 > >>  > We only need to create the Host with name 'ctDIR8' and everything 
 > >> works like a charm ... so only the"hosts" file needs tob e changed when 
 > >> adding/removing Hosts ...
 > >>  >
 > >> You do not need custom Config Files for each host. You could put Perl 
 > >> code in config.pl if you want... and putting custom code in a config file 
 > >> is IMHO a much better option than patching a perl module.
 > >
 > > But as far as I see I cannot access the $HOST Variable within config.pl to 
 > > be used in RsyncShareName - or do I overlook something?
 > >
 > > $Conf{RsyncShareName} = [
 > >   '/tmp'//this should be $HOST 
 > > (Case-Sensitive)
 > > ];
 > >
 > 
 > Aren't $client and $host set by the time you need them (as documented
 > to be used in $Conf(RsyncArgs}, $conf{DumpPreUserCmd}, etc.)?
 > 
You are correct that at the time the config file is sourced, the
variable $host (not $HOST) has not yet been set.
I get around this by linking all my config files for the same type of
system to a single master version in the /etc/BackupPC/pc directory.
Then I can recover the host name since it is the name of the file
sourced by 'do' when the config file is read.

For example, I set:
$jhost = $_[1];

This allows me to use a single master config file (with links to it by
host name) that operates differently on different hostnames. 

For example:
if($jhost eq 'machine1') {} else {...}

This allows me to maintain only a single config file with many
customizations applied to all the systems linked to the file but certain
customizations can be further customized for specific machines using
the above.

To get around other limitations, several of the 'cmd' variables allow
the passing of Perl code which is executed at runtime when all such
variables are set. You have to be careful though, because then you
can't use the $Conf{} construct, but must use \$bpc->{Conf}{}.
Other variables similarly may have different names.

For example, when I use rsyncd on a Windows machine, I use code like
this to set RsyncdPasswd by first ssh'ing into the remote host to read
the rsyncd.secrets file rather than having to store it in my config
file which could be a security issue.

$Conf{DumpPreUserCmd} = ["&{sub { chomp(\$bpc->{Conf}{RsyncdPasswd} = 
`$Conf{SshPath} -q -x -i $BackupPCsshID -l $Conf{RsyncdUserName} 
\$args[0]->{hostIP} cat /etc/rsyncd.secrets`); return(\$? . '\n'); }}"];

Yeah its a hairy hack (and the code I actually use is even hairier
since I do multiple things via DumpPreUserCmd) and of course it may
break under new versions, but it does what I need and it was fun
though painful to figure out...

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Feature Request

2014-08-28 Thread Les Mikesell
On Thu, Aug 28, 2014 at 12:18 PM, Andreas Schnederle-Wagner -
Futureweb.at  wrote:
>
>> Andreas Schnederle-Wagner - Futureweb.at wrote at about 15:41:11 + on 
>> Thursday, August 28, 2014:
>>  > The Reason we did this ist o avoid custom Config Files for each Host.
>>  > We only need to create the Host with name 'ctDIR8' and everything works 
>> like a charm ... so only the"hosts" file needs tob e changed when 
>> adding/removing Hosts ...
>>  >
>> You do not need custom Config Files for each host. You could put Perl code 
>> in config.pl if you want... and putting custom code in a config file is IMHO 
>> a much better option than patching a perl module.
>
> But as far as I see I cannot access the $HOST Variable within config.pl to be 
> used in RsyncShareName - or do I overlook something?
>
> $Conf{RsyncShareName} = [
>   '/tmp'//this should be $HOST 
> (Case-Sensitive)
> ];
>

Aren't $client and $host set by the time you need them (as documented
to be used in $Conf(RsyncArgs}, $conf{DumpPreUserCmd}, etc.)?

-- 
   Les Mikesell
 lesmikes...@gmail.com

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Feature Request

2014-08-28 Thread Andreas Schnederle-Wagner - Futureweb . at

> Andreas Schnederle-Wagner - Futureweb.at wrote at about 15:41:11 + on 
> Thursday, August 28, 2014:
>  > The Reason we did this ist o avoid custom Config Files for each Host.
>  > We only need to create the Host with name 'ctDIR8' and everything works 
> like a charm ... so only the"hosts" file needs tob e changed when 
> adding/removing Hosts ...
>  >
> You do not need custom Config Files for each host. You could put Perl code in 
> config.pl if you want... and putting custom code in a config file is IMHO a 
> much better option than patching a perl module.

But as far as I see I cannot access the $HOST Variable within config.pl to be 
used in RsyncShareName - or do I overlook something?

$Conf{RsyncShareName} = [
  '/tmp'//this should be $HOST (Case-Sensitive)
];


--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Queue Order / Queue Pools

2014-08-28 Thread John Rouillard
On Thu, Aug 28, 2014 at 10:36:50AM -0500, Carl Cravens wrote:
> I can't complete all the backups in a day with a maxbackups of 1.
> It's unreasonable to micromanage the blackout periods for 70+ hosts to
> keep certain ones from overlapping.
> 
> I've coped with the problem, but it's something that an
> only-one-host-at-a-time-from-this-group feature would make a lot
> easier to deal with.

You may also want to see my post for how I dealt with it using an
external queing/semaphore mechanism. It allows one or multiple hosts
from a group to run in parallel.

http://sourceforge.net/p/backuppc/mailman/backuppc-users/thread/20090319212300.gc20...@renesys.com/

-- 
-- rouilj

John Rouillard   System Administrator
Dyn Corporation  603-244-9084 (cell)  603-643-9300 x 111

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Feature Request

2014-08-28 Thread backuppc
Andreas Schnederle-Wagner - Futureweb.at wrote at about 15:41:11 + on 
Thursday, August 28, 2014:
 > The Reason we did this ist o avoid custom Config Files for each Host.
 > We only need to create the Host with name 'ctDIR8' and everything works like 
 > a charm ... so only the"hosts" file needs tob e changed when adding/removing 
 > Hosts ...
 > 
Please DO NOT top-post -- it makes reading threads very difficult.

You do not need custom Config Files for each host. You could put Perl
code in config.pl if you want... and putting custom code in a config
file is IMHO a much better option than patching a perl module.

 > 
 > Andreas Schnederle-Wagner
 > Futureweb OG
 > Innsbrucker Str. 4
 > 6380 St. Johann
 > 
 > schnede...@futureweb.at
 > www.futureweb.at
 > www.ortsinfo.at
 > 
 > Fon: +43 (0) 5352 65335-0
 > Fax: +43 (0) 5352 65335-777
 > Gratis über Skype anrufen | Skype-ID: futureweb
 > 
 > -Ursprüngliche Nachricht-
 > Von: backu...@kosowsky.org [mailto:backu...@kosowsky.org] 
 > Gesendet: Donnerstag, 28. August 2014 17:00
 > An: General list for user discussion, questions and support
 > Betreff: Re: [BackupPC-users] Feature Request
 > 
 > Andreas Schnederle-Wagner - Futureweb.at wrote at about 14:31:49 + on 
 > Thursday, August 28, 2014:
 >  >Hello,
 >  >
 >  > 
 >  >is it possible to have variable substitution at run-time for
 >  >“RsyncShareName“?
 >  >
 >  > 
 >  >Following Scenario:
 >  > 
 >  >-  Server Directory Structure
 >  > 
 >  >o   /ctDIR1
 >  > 
 >  >o   /ctDIR2
 >  > 
 >  >o   /ctDIR3
 >  > 
 >  >o   …
 >  > 
 >  >-  Within /etc/hosts we have:
 >  > 
 >  >o   *IP-1*  ctdir1
 >  > 
 >  >o   *IP-1*  ctdir2
 >  > 
 >  >o   *IP-1*  ctdir3
 >  > 
 >  >o   *IP-2*  ctdir4
 >  > 
 >  >o   *IP-2*  ctdir5
 >  > 
 >  >o   *IP-3*  ctdir6
 >  >
 >  > 
 >  >Hosts within BackupPC: ctDIR1, ctDIR2, ctDIR3, …
 > 
 > It's not clear to me what are you trying to do?
 >  > 
 >  >Since no variable substitution is possible at the Moment (and Hosts
 >  >within BackupPC ignore Case Sensitivity …) this was only possible by
 >  >patching the Rsync.pm File …
 > 
 > While it's not clear to me what you are actually trying to do, there is a 
 > *lot* that you can do short of patching the Rsync.pm file.
 > 
 > - You can have separate config files per host
 > - You can put arbitrary executable Perl code within any host config file that
 >   is evaluated at run time which can be used to conditionally set
 >   variables like RsyncShareName at run time.
 > - Several of the variables (e.g., DumpPreUserCmd) can even take raw perl
 >   code as an argument that is executed when the corresponding routine
 >   is run.
 > 
 > In all I have been able to do some really funky things in my config files by 
 > inserting my own Perl code to make the configuration do what I want...
 > 
 > So long as version 4.x still uses a similar structure for the config file, I 
 > would imagine that one will still have plenty of flexibility and power to 
 > allow for run-time type configuration capabilities.
 > 
 > 
 >  >As BackupPC 4 will use C-compiled Rsync it’s not that easy anymore to
 >  >get this Patch into …
 > 
 > I would try to avoid a patch or Rsync.pm even in 3.x
 > 
 >  > 
 >  >So I hope it will be possible to have Variables within “RsyncShareName“
 >  >(and have $HOST be Case-Sensitive for this Case ;-))
 >  >
 >  > 
 >  >Thank you
 >  > 
 >  >Andreas Schnederle-Wagner
 >  >
 >  >
 >  > 
 >  >Andreas Schnederle-Wagner
 >  > 
 >  >Futureweb OG
 >  > 
 >  >Innsbrucker Str. 4
 >  > 
 >  >6380 St. Johann
 >  >
 >  > 
 >  >[1]schnede...@futureweb.at
 >  > 
 >  >[2]www.futureweb.at
 >  > 
 >  >[3]www.ortsinfo.at
 >  >
 >  > 
 >  >Fon: +43 (0) 5352 65335-0
 >  > 
 >  >Fax: +43 (0) 5352 65335-777
 >  > 
 >  >Gratis über Skype anrufen | Skype-ID: futureweb
 >  >
 >  > References
 >  > 
 >  >1. mailto:schnede...@futureweb.at
 >  >2. http://www.futureweb.at/
 >  >3. http://www.ortsinfo.at/
 >  > 
 > --
 >  > Slashdot TV.  
 >  > Video for Nerds.  Stuff that matters.
 >  > http://tv.slashdot.org/
 >  > ___
 >  > BackupPC-users mailing list
 >  > BackupPC-users@lists.sourceforge.net
 >  > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
 >  > Wiki:http://backuppc.wiki.sourceforge.net
 >  > Project: http://backuppc.sourceforge.net/
 > 
 > --
 > Slashdot TV.  
 > Video for Nerds.  Stuff that matters.
 > http://tv.slashdot.org/
 > ___
 > BackupPC-users mailing list
 > BackupPC-users@lists.sourceforge.net
 > List:https://lists.sourceforge.net/lists/listinfo/backu

Re: [BackupPC-users] Feature Request

2014-08-28 Thread Les Mikesell
On Thu, Aug 28, 2014 at 10:41 AM, Andreas Schnederle-Wagner -
Futureweb.at  wrote:
> The Reason we did this ist o avoid custom Config Files for each Host.
> We only need to create the Host with name 'ctDIR8' and everything works like 
> a charm ... so only the"hosts" file needs tob e changed when adding/removing 
> Hosts ...

I guess I don't see why a per-host config file would be a problem - if
you automate its creation with the appropriate contents, which would
just be a couple of lines different for each.

-- 
   Les Mikesell
 lesmikes...@gmail.com

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Queue Order / Queue Pools

2014-08-28 Thread Les Mikesell
On Thu, Aug 28, 2014 at 10:36 AM, Carl Cravens  wrote:
> I can't complete all the backups in a day with a maxbackups of 1.  It's 
> unreasonable to micromanage the blackout periods for 70+ hosts to keep 
> certain ones from overlapping.
>
> I've coped with the problem, but it's something that an 
> only-one-host-at-a-time-from-this-group feature would make a lot easier to 
> deal with.

Oh, I agree that it would be a very useful feature.  I've wanted it
myself to accommodate a mix of remote and local targets where I'd like
to group by the network paths.

-- 
  Les Mikesell
 lesmikes...@gmail.com

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Feature Request

2014-08-28 Thread Andreas Schnederle-Wagner - Futureweb . at
The Reason we did this ist o avoid custom Config Files for each Host.
We only need to create the Host with name 'ctDIR8' and everything works like a 
charm ... so only the"hosts" file needs tob e changed when adding/removing 
Hosts ...


Andreas Schnederle-Wagner
Futureweb OG
Innsbrucker Str. 4
6380 St. Johann

schnede...@futureweb.at
www.futureweb.at
www.ortsinfo.at

Fon: +43 (0) 5352 65335-0
Fax: +43 (0) 5352 65335-777
Gratis über Skype anrufen | Skype-ID: futureweb

-Ursprüngliche Nachricht-
Von: backu...@kosowsky.org [mailto:backu...@kosowsky.org] 
Gesendet: Donnerstag, 28. August 2014 17:00
An: General list for user discussion, questions and support
Betreff: Re: [BackupPC-users] Feature Request

Andreas Schnederle-Wagner - Futureweb.at wrote at about 14:31:49 + on 
Thursday, August 28, 2014:
 >Hello,
 >
 > 
 >is it possible to have variable substitution at run-time for
 >“RsyncShareName“?
 >
 > 
 >Following Scenario:
 > 
 >-  Server Directory Structure
 > 
 >o   /ctDIR1
 > 
 >o   /ctDIR2
 > 
 >o   /ctDIR3
 > 
 >o   …
 > 
 >-  Within /etc/hosts we have:
 > 
 >o   *IP-1*  ctdir1
 > 
 >o   *IP-1*  ctdir2
 > 
 >o   *IP-1*  ctdir3
 > 
 >o   *IP-2*  ctdir4
 > 
 >o   *IP-2*  ctdir5
 > 
 >o   *IP-3*  ctdir6
 >
 > 
 >Hosts within BackupPC: ctDIR1, ctDIR2, ctDIR3, …

It's not clear to me what are you trying to do?
 > 
 >Since no variable substitution is possible at the Moment (and Hosts
 >within BackupPC ignore Case Sensitivity …) this was only possible by
 >patching the Rsync.pm File …

While it's not clear to me what you are actually trying to do, there is a *lot* 
that you can do short of patching the Rsync.pm file.

- You can have separate config files per host
- You can put arbitrary executable Perl code within any host config file that
  is evaluated at run time which can be used to conditionally set
  variables like RsyncShareName at run time.
- Several of the variables (e.g., DumpPreUserCmd) can even take raw perl
  code as an argument that is executed when the corresponding routine
  is run.

In all I have been able to do some really funky things in my config files by 
inserting my own Perl code to make the configuration do what I want...

So long as version 4.x still uses a similar structure for the config file, I 
would imagine that one will still have plenty of flexibility and power to allow 
for run-time type configuration capabilities.


 >As BackupPC 4 will use C-compiled Rsync it’s not that easy anymore to
 >get this Patch into …

I would try to avoid a patch or Rsync.pm even in 3.x

 > 
 >So I hope it will be possible to have Variables within “RsyncShareName“
 >(and have $HOST be Case-Sensitive for this Case ;-))
 >
 > 
 >Thank you
 > 
 >Andreas Schnederle-Wagner
 >
 >
 > 
 >Andreas Schnederle-Wagner
 > 
 >Futureweb OG
 > 
 >Innsbrucker Str. 4
 > 
 >6380 St. Johann
 >
 > 
 >[1]schnede...@futureweb.at
 > 
 >[2]www.futureweb.at
 > 
 >[3]www.ortsinfo.at
 >
 > 
 >Fon: +43 (0) 5352 65335-0
 > 
 >Fax: +43 (0) 5352 65335-777
 > 
 >Gratis über Skype anrufen | Skype-ID: futureweb
 >
 > References
 > 
 >1. mailto:schnede...@futureweb.at
 >2. http://www.futureweb.at/
 >3. http://www.ortsinfo.at/
 > --
 > Slashdot TV.  
 > Video for Nerds.  Stuff that matters.
 > http://tv.slashdot.org/
 > ___
 > BackupPC-users mailing list
 > BackupPC-users@lists.sourceforge.net
 > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
 > Wiki:http://backuppc.wiki.sourceforge.net
 > Project: http://backuppc.sourceforge.net/

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Queue Order / Queue Pools

2014-08-28 Thread Carl Cravens
I can't complete all the backups in a day with a maxbackups of 1.  It's 
unreasonable to micromanage the blackout periods for 70+ hosts to keep certain 
ones from overlapping.

I've coped with the problem, but it's something that an 
only-one-host-at-a-time-from-this-group feature would make a lot easier to deal 
with.

On 08/28/2014 09:45 AM, Les Mikesell wrote:
> On Thu, Aug 28, 2014 at 8:11 AM, Carl Cravens  wrote:
>> This is a feature I've wanted as well.  I have virtual machines running on 
>> multiple hypervisors, and I'd prefer to only run one backup per hypervisor 
>> at a time.  If I could do that, I could get away with backups during the 
>> day... but if I back up the main file server and the groupware server at the 
>> same time, tech support starts getting calls about things being slow.
>>
>
> Have you tried taking MaxBackups down to 1 to see if backups will
> still complete in the available time?   Or skewing the blackout
> periods for the host and guest systems?
>
-- 
Carl D Cravens (ccrav...@excelii.com), Ext 228 (620.327.1228)
Lead System Architect

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Feature Request

2014-08-28 Thread Les Mikesell
On Thu, Aug 28, 2014 at 9:59 AM,   wrote:
>>
> While it's not clear to me what you are actually trying to do, there
> is a *lot* that you can do short of patching the Rsync.pm file.
>
> - You can have separate config files per host
> - You can put arbitrary executable Perl code within any host config file that
>   is evaluated at run time which can be used to conditionally set
>   variables like RsyncShareName at run time.

Note that if you do add run-time perl code in the configs you'll
probably lose the ability to use the web 'edit config' interface.
Also, you can set the IP targets independently from the hostname by
using ClientNameAlias in the per-host configs - you don't really need
the settings in the system /etc/hosts file.   If I needed to do
something like that I would probably set up one configuration using
the web interface's per-host 'Edit Confilg', then for a small number
of variations add the others using the 'newhost=oldhost' syntax in
'Edit Hosts' followed by changing just the ClientNameAlias and the
RsyncShareName settings, or for a large number of targets, write
something to generate the appropriate per-host config files using the
first as a template.

-- 
   Les Mikesell
 lesmikes...@gmail.com

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Feature Request

2014-08-28 Thread backuppc
Andreas Schnederle-Wagner - Futureweb.at wrote at about 14:31:49 + on 
Thursday, August 28, 2014:
 >Hello,
 > 
 > 
 >is it possible to have variable substitution at run-time for
 >“RsyncShareName“?
 > 
 > 
 >Following Scenario:
 > 
 >-  Server Directory Structure
 > 
 >o   /ctDIR1
 > 
 >o   /ctDIR2
 > 
 >o   /ctDIR3
 > 
 >o   …
 > 
 >-  Within /etc/hosts we have:
 > 
 >o   *IP-1*  ctdir1
 > 
 >o   *IP-1*  ctdir2
 > 
 >o   *IP-1*  ctdir3
 > 
 >o   *IP-2*  ctdir4
 > 
 >o   *IP-2*  ctdir5
 > 
 >o   *IP-3*  ctdir6
 > 
 > 
 >Hosts within BackupPC: ctDIR1, ctDIR2, ctDIR3, …

It's not clear to me what are you trying to do?
 > 
 >Since no variable substitution is possible at the Moment (and Hosts
 >within BackupPC ignore Case Sensitivity …) this was only possible by
 >patching the Rsync.pm File …

While it's not clear to me what you are actually trying to do, there
is a *lot* that you can do short of patching the Rsync.pm file.

- You can have separate config files per host
- You can put arbitrary executable Perl code within any host config file that
  is evaluated at run time which can be used to conditionally set
  variables like RsyncShareName at run time.
- Several of the variables (e.g., DumpPreUserCmd) can even take raw perl
  code as an argument that is executed when the corresponding routine
  is run.

In all I have been able to do some really funky things in my config
files by inserting my own Perl code to make the configuration do what
I want...

So long as version 4.x still uses a similar structure for the
config file, I would imagine that one will still have plenty of
flexibility and power to allow for run-time type configuration
capabilities.


 >As BackupPC 4 will use C-compiled Rsync it’s not that easy anymore to
 >get this Patch into …

I would try to avoid a patch or Rsync.pm even in 3.x

 > 
 >So I hope it will be possible to have Variables within “RsyncShareName“
 >(and have $HOST be Case-Sensitive for this Case ;-))
 > 
 > 
 >Thank you
 > 
 >Andreas Schnederle-Wagner
 > 
 > 
 > 
 >Andreas Schnederle-Wagner
 > 
 >Futureweb OG
 > 
 >Innsbrucker Str. 4
 > 
 >6380 St. Johann
 > 
 > 
 >[1]schnede...@futureweb.at
 > 
 >[2]www.futureweb.at
 > 
 >[3]www.ortsinfo.at
 > 
 > 
 >Fon: +43 (0) 5352 65335-0
 > 
 >Fax: +43 (0) 5352 65335-777
 > 
 >Gratis über Skype anrufen | Skype-ID: futureweb
 > 
 > References
 > 
 >1. mailto:schnede...@futureweb.at
 >2. http://www.futureweb.at/
 >3. http://www.ortsinfo.at/
 > --
 > Slashdot TV.  
 > Video for Nerds.  Stuff that matters.
 > http://tv.slashdot.org/
 > ___
 > BackupPC-users mailing list
 > BackupPC-users@lists.sourceforge.net
 > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
 > Wiki:http://backuppc.wiki.sourceforge.net
 > Project: http://backuppc.sourceforge.net/

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Queue Order / Queue Pools

2014-08-28 Thread Les Mikesell
On Thu, Aug 28, 2014 at 8:11 AM, Carl Cravens  wrote:
> This is a feature I've wanted as well.  I have virtual machines running on 
> multiple hypervisors, and I'd prefer to only run one backup per hypervisor at 
> a time.  If I could do that, I could get away with backups during the day... 
> but if I back up the main file server and the groupware server at the same 
> time, tech support starts getting calls about things being slow.
>

Have you tried taking MaxBackups down to 1 to see if backups will
still complete in the available time?   Or skewing the blackout
periods for the host and guest systems?

-- 
   Les Mikesell
  lesmikes...@gmail.com

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] Feature Request

2014-08-28 Thread Andreas Schnederle-Wagner - Futureweb . at
Hello,

is it possible to have variable substitution at run-time for "RsyncShareName"?

Following Scenario:

-  Server Directory Structure

o   /ctDIR1

o   /ctDIR2

o   /ctDIR3

o   ...

-  Within /etc/hosts we have:

o   *IP-1*  ctdir1

o   *IP-1*  ctdir2

o   *IP-1*  ctdir3

o   *IP-2*  ctdir4

o   *IP-2*  ctdir5

o   *IP-3*  ctdir6

Hosts within BackupPC: ctDIR1, ctDIR2, ctDIR3, ...

Since no variable substitution is possible at the Moment (and Hosts within 
BackupPC ignore Case Sensitivity ...) this was only possible by patching the 
Rsync.pm File ...
As BackupPC 4 will use C-compiled Rsync it's not that easy anymore to get this 
Patch into ...

So I hope it will be possible to have Variables within "RsyncShareName" (and 
have $HOST be Case-Sensitive for this Case ;-))

Thank you
Andreas Schnederle-Wagner


Andreas Schnederle-Wagner
Futureweb OG
Innsbrucker Str. 4
6380 St. Johann

schnede...@futureweb.at
www.futureweb.at
www.ortsinfo.at

Fon: +43 (0) 5352 65335-0
Fax: +43 (0) 5352 65335-777
Gratis über Skype anrufen | Skype-ID: futureweb

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Queue Order / Queue Pools

2014-08-28 Thread Carl Cravens
This is a feature I've wanted as well.  I have virtual machines running on 
multiple hypervisors, and I'd prefer to only run one backup per hypervisor at a 
time.  If I could do that, I could get away with backups during the day... but 
if I back up the main file server and the groupware server at the same time, 
tech support starts getting calls about things being slow.

On 08/28/2014 08:03 AM, Les Mikesell wrote:
> On Thu, Aug 28, 2014 at 7:01 AM, Andreas Schnederle-Wagner -
> Futureweb.at  wrote:
>>
>> Is it possible that backuppc allows you to put your hosts into groups (aka
>> queues) so that you could limit the number of backup jobs running from any
>> specific queue/host group?
>>
>
> No you can't do that by groups, but unless you have a mix of fast and
> slow networks/hosts you will probably get the best performance by
> setting the overall concurrency (MaxBackups) to 2 or so since you have
> the same problem server-side.   You can have some control over timing
> by setting the blackout periods differently and you can initially skew
> them by doing a 'stop' (even if a backup isn't running) and setting a
> number of hours to defer the next run.The approximately 24-hour
> scheduling will maintain the skew afterward.
>
-- 
Carl D Cravens (ccrav...@excelii.com), Ext 228 (620.327.1228)
Lead System Architect

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Queue Order / Queue Pools

2014-08-28 Thread Les Mikesell
On Thu, Aug 28, 2014 at 7:01 AM, Andreas Schnederle-Wagner -
Futureweb.at  wrote:
>
> Is it possible that backuppc allows you to put your hosts into groups (aka
> queues) so that you could limit the number of backup jobs running from any
> specific queue/host group?
>

No you can't do that by groups, but unless you have a mix of fast and
slow networks/hosts you will probably get the best performance by
setting the overall concurrency (MaxBackups) to 2 or so since you have
the same problem server-side.   You can have some control over timing
by setting the blackout periods differently and you can initially skew
them by doing a 'stop' (even if a backup isn't running) and setting a
number of hours to defer the next run.The approximately 24-hour
scheduling will maintain the skew afterward.

-- 
  Les Mikesell
 lesmikes...@gmail.com

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] Queue Order / Queue Pools

2014-08-28 Thread Andreas Schnederle-Wagner - Futureweb . at
Hello,

we backup several Servers with BackupPC - on every server we got several 
Directories - everyone as an own Host ... (dir1, dir2, dir3, ... and mapped 
those names to the IP in /etc/hosts)
Is it possible that backuppc allows you to put your hosts into groups (aka 
queues) so that you could limit the number of backup jobs running from any 
specific queue/host group?

Thank you


Andreas Schnederle-Wagner
Futureweb OG
Innsbrucker Str. 4
6380 St. Johann

schnede...@futureweb.at
www.futureweb.at
www.ortsinfo.at

Fon: +43 (0) 5352 65335-0
Fax: +43 (0) 5352 65335-777
Gratis über Skype anrufen | Skype-ID: futureweb

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Best backup system for Windows clients

2014-08-28 Thread Sorin Srbu
> -Original Message-
> From: Robert Wooden [mailto:rbrte...@comcast.net]
> Sent: den 27 augusti 2014 13:19
> To: General list for user discussion, questions and support
> Subject: Re: [BackupPC-users] Best backup system for Windows clients
>
> To Doug Lytle and Sorin Srbu,
>
> Thanks for your views.
>
> Regarding Deltacopy, tried this years ago. Did not know that would not
> handle files in use. Did think much of it then.
>
> Mr. Stowe,
> I have tried your page http://www.michaelstowe.com/backuppc/ it
> appeared to be the most concise. Thank you for your efforts.
>
> My last failed attempt was a full Cygwin install on W7 machine that would
> not
> let ssh start. Did not have time then to get into why, then but, I will make
> time this coming weekend.

FWIW, I've taken (with the original author's blessing) over and expanded a bit
over the years on the original BPC install notes from the CentOS-site.

http://srbu.se/backuppc.html

I just upadated the guide with Doug Lytle's comment on Deltacopy, VSS and
Win7.

Hopefully it might be of help to somebody.
--
//Sorin


smime.p7s
Description: S/MIME cryptographic signature
--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/