Re: [BackupPC-users] Why no files where transferred in this session?

2009-04-14 Thread Boniforti Flavio
Hallo Matthias,

> Whats happen after this sleep of 60 seconds? I would believe 
> that ssh stop the tunnel.
> And than rsync read this EOF.

Mmmhhh... Well, could it be that for some reason there has been a
timeout greater than 60 seconds and *thus* the ssh tunnel shut down,
while rsync was waiting for its timeout?

> I backup my vista client by starting the ssh tunnel from vista side:
> /bin/nice -n 10 /bin/autossh -R :localhost:22 -M 
> 0 -N -C -i /etc/ssh/id_rsa -p 22 u...@server.domain.at or 
> install it as a service via cygrunsrv.
> The ssh tunnel is open the whole day and my server can 
> connect to the client whenever he want.

Nice, but what happens if the SSH goes down? It is also my concern! :-/

Regards,
Flavio Boniforti.

--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)

2009-04-14 Thread Boniforti Flavio
> As long as the other ssh has gone away and is no longer 
> listening on the
>   local forwarding port you should be able to start another instance. 
> It if is a problem you could wrap the ssh command in a script 
> that sleeps a few seconds first to make sure the previous run 
> has time to close down.

Just wanted to confirm that the "DumpPreUserShare" has solved my
connection gap troubles.

Sadly, I *still* have to fight with the transfer of big files, which
doesn't succeed! :-/

--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Why no files where transferred in this session?

2009-04-14 Thread Matthias Meyer
Boniforti Flavio wrote:

> Hello list!
> 
> This is the log from my last attempt to sync a directory containing 2 big
> files:
> 
> Executing DumpPreUserCmd: /var/lib/backuppc/tunnel.sh -fC
> administra...@mail.omvsa.ch -L 8874:127.0.0.1:873 sleep 60
> SSH started successfully.
> incr backup started back to 2009-04-10 17:33:03 (backup #2) for directory
> ExchBkp
> Connected to localhost:8874, remote version 30
> Negotiated protocol version 28
> Connected to module ExchBkp
> Sending args: --server --sender --numeric-ids --perms --owner --group -D
> --links --hard-links --block-size=2048 --recursive . .
> Checksum seed is 1239544143
> Got checksumSeed 0x49e1f14f
> Got file (0 of 3): .
> Got file (1 of 3): Exchange1.bkf
> Got file (2 of 3): Exchange2.bkf
> Got file list: 3 entries
> Child PID is 748
> Xfer PIDs are now 748
> Sending csums, cnt = 3, phase = 0
> Sending csums, cnt = 0, phase = 1
> attribSet: dir= not found
> attribSet(dir=, file=ExchBkp, size=0, placeholder=1)
>   create d 755   400/401   0 .
> attribSet: dir= exists
> attribSet(dir=, file=ExchBkp, size=0, placeholder=)
> Read EOF:

Whats happen after this sleep of 60 seconds? I would believe that ssh stop
the tunnel.
And than rsync read this EOF.

I backup my vista client by starting the ssh tunnel from vista side:
/bin/nice -n 10 /bin/autossh -R :localhost:22 -M
0 -N -C -i /etc/ssh/id_rsa -p 22 u...@server.domain.at
or install it as a service via cygrunsrv.
The ssh tunnel is open the whole day and my server can connect to the client
whenever he want.

br
Matthias
-- 
Don't Panic


--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] RSYNC xfer failing backuppc version 3.2.0beta0

2009-04-14 Thread Tim Hall
Hi Thanks for the support.  I installed
the File:Listing module and my backups
are working now.

>>> Craig Barratt  4/13/2009 11:33 PM >>>
Tim writes:

> This is a new install so I thought I would try the beta version
> do you recommend I go back to the stable version?

If you are willing to test the beta version some more that
would be great.  You've already found one bug :).

Holger told you where to get the File::Listing module.
Another workaround is to simply comment out this line in

use File::Listing qw/parse_dir/;

in

lib/BackupPC/Xfer/ftp.pm 

(ie: add a single "#" character at the start of the line, or
delete it altogether).  You won't be able to use ftp, but
everything else should work.

Craig
--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Have global exclusions stay global?

2009-04-14 Thread oblivian
Hi again,

A future option I really would love to see, is the ability to create 
several sets of global/universal of exlude/include filters and being 
able to just "tick" one or more set of filters that apply to the 
different clients. And then of course have the option to set filters 
specific to one particular client.

Best,

Oblivian

oblivian wrote:
> Hi Craig,
>
> Sounds great. Looking forward to a future release then.
>
> :-)
>
> Obi
>
> Craig Barratt wrote:
>> Oblivian,
>>
>> As you point out, there isn't a general method for merging per-client
>> settings with the global ones.
>>
>> However, in 3.2.0beta0 there is a new config variable
>> $Conf{RsyncArgsExtra} which is combined with $Conf{RsyncArgs}.
>> The purpose is exactly for your application: you can use
>> $Conf{RsyncArgs} for the global settings and $Conf{RsyncArgsExtra}
>> for the per-client settings.
>>
>> For excludes you would need to use rsync-type arguments (ie: --exclude)
>> in $Conf{RsyncArgsExtra}.
>>
>> Craig
>>   
>

--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)

2009-04-14 Thread Les Mikesell
Boniforti Flavio wrote:
> 
> 
> Il 14.04.09 16:55, "Les Mikesell"  ha scritto:
> 
>> I happen to like openvpn running in peer to
>> peer mode where you end up with a process and tunnel interface per
>> instance. 
> 
> OK, so I will take a look at openvpn. Leaving the VPN open is not a problem,
> of course...

I'm on the openvpn mail list too, so ask there if you have any problems. 
  For a simple host to host connection you don't need to deal with any 
routing issues - just give each end adjacent private IP addresses that 
are in networks you don't use anywhere else.  If you want to route for 
the rest of the LAN it gets a little more complicated.

-- 
   Les Mikesell
lesmikes...@gmail.com



--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] Why no files where transferred in this session?

2009-04-14 Thread Boniforti Flavio
Hello list!

This is the log from my last attempt to sync a directory containing 2 big
files:

Executing DumpPreUserCmd: /var/lib/backuppc/tunnel.sh -fC
administra...@mail.omvsa.ch -L 8874:127.0.0.1:873 sleep 60
SSH started successfully.
incr backup started back to 2009-04-10 17:33:03 (backup #2) for directory
ExchBkp
Connected to localhost:8874, remote version 30
Negotiated protocol version 28
Connected to module ExchBkp
Sending args: --server --sender --numeric-ids --perms --owner --group -D
--links --hard-links --block-size=2048 --recursive . .
Checksum seed is 1239544143
Got checksumSeed 0x49e1f14f
Got file (0 of 3): .
Got file (1 of 3): Exchange1.bkf
Got file (2 of 3): Exchange2.bkf
Got file list: 3 entries
Child PID is 748
Xfer PIDs are now 748
Sending csums, cnt = 3, phase = 0
Sending csums, cnt = 0, phase = 1
attribSet: dir= not found
attribSet(dir=, file=ExchBkp, size=0, placeholder=1)
  create d 755   400/401   0 .
attribSet: dir= exists
attribSet(dir=, file=ExchBkp, size=0, placeholder=)
Read EOF:
Tried again: got 0 bytes
Got done from child
Got stats: 1092843308 1562234153 3836067335 0 ('errorCnt' =>
0,'ExistFileSize' => 0,'ExistFileCnt' => 0,'TotalFileCnt' =>
0,'ExistFileCompSize' => 0,'TotalFileSize' => 0)
finish: removing in-process file Exchange1.bkf
attribWrite(dir=) -> /var/lib/backuppc/pc/mail.omvsa.ch/new//attrib
Child is aborting
Got exit from child
Done: 0 files, 0 bytes
incr backup started back to 2009-04-10 17:33:03 (backup #2) for directory
profilo
Error connecting to rsync daemon at localhost:8874: inet connect:
Connessione rifiutata
Got fatal error during xfer (inet connect: Connessione rifiutata)
Backup aborted (inet connect: Connessione rifiutata)


Ignoring the fact that the directory ³profilo² doesn¹t get backed up (need
to tune the timouts, check ssh and maybe switch to VPN), why wouldn¹t
BackupPC transfer those 2 files?

Thanks in advance,
Flavio Boniforti

PIRAMIDE INFORMATICA SAGL
Via Ballerini 21
6600 Locarno
Switzerland
Phone: +41 91 751 68 81
Fax: +41 91 751 69 14
URL: http://www.piramide.ch
E-mail: fla...@piramide.ch


--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)

2009-04-14 Thread Boniforti Flavio



Il 14.04.09 16:55, "Les Mikesell"  ha scritto:

> I happen to like openvpn running in peer to
> peer mode where you end up with a process and tunnel interface per
> instance. 

OK, so I will take a look at openvpn. Leaving the VPN open is not a problem,
of course...

Thanks,
F.


--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)

2009-04-14 Thread Les Mikesell
Boniforti Flavio wrote:
>> But, a generic vpn would make life simple.
> 
> I would really *love* to set up a VPN: can you help? I already have VPN
> configured on the server (Windows 2003 SBS SP2), I (think) I just need
> some command-line linux client, which would open the VPN connection
> (DumpPreUserCmd) and having transferred all the data, simply "close the
> gate".
> 
> Any suggestions?

What's the problem with leaving it up all the time so you can manage the 
target(s) over it as well as doing backups?  You'd normally want your 
backuppc server to be fairly secure anyway - or you might want to route 
through a different VPN server handling routes for the whole LANs on 
each side.  If you do need to start and stop it, the technique will 
depend on the vpn program.  I happen to like openvpn running in peer to 
peer mode where you end up with a process and tunnel interface per 
instance.  So you'd leave the target side up and listening all the time 
and the backuppc server side would start the program with the relevant 
config file to open the tunnel and either kill it or "ifconfig down" the 
tunnel interface to stop it.

-- 
   Les Mikesell
lesmikes...@gmail.com

--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)

2009-04-14 Thread Boniforti Flavio

> But, a generic vpn would make life simple.

I would really *love* to set up a VPN: can you help? I already have VPN
configured on the server (Windows 2003 SBS SP2), I (think) I just need
some command-line linux client, which would open the VPN connection
(DumpPreUserCmd) and having transferred all the data, simply "close the
gate".

Any suggestions?

TIA,
Flavio Boniforti.

--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)

2009-04-14 Thread Les Mikesell
Boniforti Flavio wrote:
>> Alternatively, set up the tunnel in DumpPreShareCmd instead 
>> of DumpPreUserCmd.
>> Then you will be using a new tunnel for each share.
> 
> May I be using the same TCP ports for it?
> That is my only concern right now...

As long as the other ssh has gone away and is no longer listening on the 
  local forwarding port you should be able to start another instance. 
It if is a problem you could wrap the ssh command in a script that 
sleeps a few seconds first to make sure the previous run has time to 
close down.

But, a generic vpn would make life simple.

-- 
   Les Mikesell
lesmikes...@gmail.com

--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Have global exclusions stay global?

2009-04-14 Thread Les Mikesell
Craig Barratt wrote:
> Oblivian,
> 
> As you point out, there isn't a general method for merging per-client
> settings with the global ones.
> 
> However, in 3.2.0beta0 there is a new config variable
> $Conf{RsyncArgsExtra} which is combined with $Conf{RsyncArgs}.
> The purpose is exactly for your application: you can use
> $Conf{RsyncArgs} for the global settings and $Conf{RsyncArgsExtra}
> for the per-client settings.
> 
> For excludes you would need to use rsync-type arguments (ie: --exclude)
> in $Conf{RsyncArgsExtra}.

As a work-around when adding new targets you can use an existing host 
with the common settings as the template with the NEWHOST=COPYHOST 
feature so you only have to edit the unique parts.  Doesn't help when 
the global setting change later, though.

-- 
   Les Mikesell
lesmikes...@gmail.com



--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)

2009-04-14 Thread Boniforti Flavio

> I have (successfully) been using a script to do this for the 
> past few months. I copied this from somewhere else (the wiki 
> perhaps) and have tuned locally since then...
> 
> I created a script in /etc/backuppc/scripts/hostname.sh 
> #!/bin/bash TERM=vt100 /usr/bin/screen -d -m -S hosttunnel 
> /usr/bin/ssh -o
> ServerAliveInterval=15 -o ServerAliveCountMax=10 -q -x -C -L
> 1516:127.0.0.1:873 -l root host
> /bin/sleep 20
> 
> # NOTE: sleep 20? we needed to introduce a small delay to 
> ensure the tunnel was fully established before rsync started 
> # NOTE: "-S hosttunnel" helps us identify the process - so we 
> can kill it when the backups are finished # NOTE: This could 
> be done with dtach instead of screen # NOTE: the string host 
> should be replaced with the hostname
> 
> $Conf{ClientNameAlias} = '127.0.0.1';
> $Conf{DumpPreUserCmd}='/etc/backuppc/scripts/host.sh';
> $Conf{DumpPostUserCmd}='/usr/bin/pkill -u backuppc -f host'; 
> $Conf{RestorePreUserCmd}='/etc/backuppc/scripts/host.sh';
> $Conf{RestorePostUserCmd}='/usr/bin/pkill -u backuppc -f 
> host'; $Conf{RsyncdClientPort}='1516'; # This 1516 matches 
> the 1516 in the above script, each tunneled host should use a 
> unique port number so that parallel backups don't interfere 
> with each other
> 
> 
> Hope that helps, if anyone sees something wrong with the 
> above config, please let me know.

I'm interested in understanding how and why it is working in your
environment: can you explain?

Thanks...

--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)

2009-04-14 Thread Boniforti Flavio

> Alternatively, set up the tunnel in DumpPreShareCmd instead 
> of DumpPreUserCmd.
> Then you will be using a new tunnel for each share.

May I be using the same TCP ports for it?
That is my only concern right now...

--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Backup remote ftp server (internet site)

2009-04-14 Thread Mirco Piccin
HI

> The values in your config.pl script appear to be correct.  The
> "Invalid argument" error is a protocol-level error.  I'll need some
> more information to figure out what's going on.

ok, let's go on!

> What ftp server are you running?

as i said, that's an internet site; there's a ProFTPD 1.3.0 Server
(Debian) used to upload & manage site files.

> Have you made any changes to your server configuration lately?

I think that no changes were made.

> Can you confirm that you can access the
> server with a different FTP client?

of course (i.e. gftp).

> What do the log files for your FTP server look like?

i've not ftp server log (not available for me..).
Regards
M

--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/