Re: [BackupPC-users] Why no files where transferred in this session?
Hallo Matthias, > Whats happen after this sleep of 60 seconds? I would believe > that ssh stop the tunnel. > And than rsync read this EOF. Mmmhhh... Well, could it be that for some reason there has been a timeout greater than 60 seconds and *thus* the ssh tunnel shut down, while rsync was waiting for its timeout? > I backup my vista client by starting the ssh tunnel from vista side: > /bin/nice -n 10 /bin/autossh -R :localhost:22 -M > 0 -N -C -i /etc/ssh/id_rsa -p 22 u...@server.domain.at or > install it as a service via cygrunsrv. > The ssh tunnel is open the whole day and my server can > connect to the client whenever he want. Nice, but what happens if the SSH goes down? It is also my concern! :-/ Regards, Flavio Boniforti. -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)
> As long as the other ssh has gone away and is no longer > listening on the > local forwarding port you should be able to start another instance. > It if is a problem you could wrap the ssh command in a script > that sleeps a few seconds first to make sure the previous run > has time to close down. Just wanted to confirm that the "DumpPreUserShare" has solved my connection gap troubles. Sadly, I *still* have to fight with the transfer of big files, which doesn't succeed! :-/ -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Why no files where transferred in this session?
Boniforti Flavio wrote: > Hello list! > > This is the log from my last attempt to sync a directory containing 2 big > files: > > Executing DumpPreUserCmd: /var/lib/backuppc/tunnel.sh -fC > administra...@mail.omvsa.ch -L 8874:127.0.0.1:873 sleep 60 > SSH started successfully. > incr backup started back to 2009-04-10 17:33:03 (backup #2) for directory > ExchBkp > Connected to localhost:8874, remote version 30 > Negotiated protocol version 28 > Connected to module ExchBkp > Sending args: --server --sender --numeric-ids --perms --owner --group -D > --links --hard-links --block-size=2048 --recursive . . > Checksum seed is 1239544143 > Got checksumSeed 0x49e1f14f > Got file (0 of 3): . > Got file (1 of 3): Exchange1.bkf > Got file (2 of 3): Exchange2.bkf > Got file list: 3 entries > Child PID is 748 > Xfer PIDs are now 748 > Sending csums, cnt = 3, phase = 0 > Sending csums, cnt = 0, phase = 1 > attribSet: dir= not found > attribSet(dir=, file=ExchBkp, size=0, placeholder=1) > create d 755 400/401 0 . > attribSet: dir= exists > attribSet(dir=, file=ExchBkp, size=0, placeholder=) > Read EOF: Whats happen after this sleep of 60 seconds? I would believe that ssh stop the tunnel. And than rsync read this EOF. I backup my vista client by starting the ssh tunnel from vista side: /bin/nice -n 10 /bin/autossh -R :localhost:22 -M 0 -N -C -i /etc/ssh/id_rsa -p 22 u...@server.domain.at or install it as a service via cygrunsrv. The ssh tunnel is open the whole day and my server can connect to the client whenever he want. br Matthias -- Don't Panic -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] RSYNC xfer failing backuppc version 3.2.0beta0
Hi Thanks for the support. I installed the File:Listing module and my backups are working now. >>> Craig Barratt 4/13/2009 11:33 PM >>> Tim writes: > This is a new install so I thought I would try the beta version > do you recommend I go back to the stable version? If you are willing to test the beta version some more that would be great. You've already found one bug :). Holger told you where to get the File::Listing module. Another workaround is to simply comment out this line in use File::Listing qw/parse_dir/; in lib/BackupPC/Xfer/ftp.pm (ie: add a single "#" character at the start of the line, or delete it altogether). You won't be able to use ftp, but everything else should work. Craig -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Have global exclusions stay global?
Hi again, A future option I really would love to see, is the ability to create several sets of global/universal of exlude/include filters and being able to just "tick" one or more set of filters that apply to the different clients. And then of course have the option to set filters specific to one particular client. Best, Oblivian oblivian wrote: > Hi Craig, > > Sounds great. Looking forward to a future release then. > > :-) > > Obi > > Craig Barratt wrote: >> Oblivian, >> >> As you point out, there isn't a general method for merging per-client >> settings with the global ones. >> >> However, in 3.2.0beta0 there is a new config variable >> $Conf{RsyncArgsExtra} which is combined with $Conf{RsyncArgs}. >> The purpose is exactly for your application: you can use >> $Conf{RsyncArgs} for the global settings and $Conf{RsyncArgsExtra} >> for the per-client settings. >> >> For excludes you would need to use rsync-type arguments (ie: --exclude) >> in $Conf{RsyncArgsExtra}. >> >> Craig >> > -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)
Boniforti Flavio wrote: > > > Il 14.04.09 16:55, "Les Mikesell" ha scritto: > >> I happen to like openvpn running in peer to >> peer mode where you end up with a process and tunnel interface per >> instance. > > OK, so I will take a look at openvpn. Leaving the VPN open is not a problem, > of course... I'm on the openvpn mail list too, so ask there if you have any problems. For a simple host to host connection you don't need to deal with any routing issues - just give each end adjacent private IP addresses that are in networks you don't use anywhere else. If you want to route for the rest of the LAN it gets a little more complicated. -- Les Mikesell lesmikes...@gmail.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Why no files where transferred in this session?
Hello list! This is the log from my last attempt to sync a directory containing 2 big files: Executing DumpPreUserCmd: /var/lib/backuppc/tunnel.sh -fC administra...@mail.omvsa.ch -L 8874:127.0.0.1:873 sleep 60 SSH started successfully. incr backup started back to 2009-04-10 17:33:03 (backup #2) for directory ExchBkp Connected to localhost:8874, remote version 30 Negotiated protocol version 28 Connected to module ExchBkp Sending args: --server --sender --numeric-ids --perms --owner --group -D --links --hard-links --block-size=2048 --recursive . . Checksum seed is 1239544143 Got checksumSeed 0x49e1f14f Got file (0 of 3): . Got file (1 of 3): Exchange1.bkf Got file (2 of 3): Exchange2.bkf Got file list: 3 entries Child PID is 748 Xfer PIDs are now 748 Sending csums, cnt = 3, phase = 0 Sending csums, cnt = 0, phase = 1 attribSet: dir= not found attribSet(dir=, file=ExchBkp, size=0, placeholder=1) create d 755 400/401 0 . attribSet: dir= exists attribSet(dir=, file=ExchBkp, size=0, placeholder=) Read EOF: Tried again: got 0 bytes Got done from child Got stats: 1092843308 1562234153 3836067335 0 ('errorCnt' => 0,'ExistFileSize' => 0,'ExistFileCnt' => 0,'TotalFileCnt' => 0,'ExistFileCompSize' => 0,'TotalFileSize' => 0) finish: removing in-process file Exchange1.bkf attribWrite(dir=) -> /var/lib/backuppc/pc/mail.omvsa.ch/new//attrib Child is aborting Got exit from child Done: 0 files, 0 bytes incr backup started back to 2009-04-10 17:33:03 (backup #2) for directory profilo Error connecting to rsync daemon at localhost:8874: inet connect: Connessione rifiutata Got fatal error during xfer (inet connect: Connessione rifiutata) Backup aborted (inet connect: Connessione rifiutata) Ignoring the fact that the directory ³profilo² doesn¹t get backed up (need to tune the timouts, check ssh and maybe switch to VPN), why wouldn¹t BackupPC transfer those 2 files? Thanks in advance, Flavio Boniforti PIRAMIDE INFORMATICA SAGL Via Ballerini 21 6600 Locarno Switzerland Phone: +41 91 751 68 81 Fax: +41 91 751 69 14 URL: http://www.piramide.ch E-mail: fla...@piramide.ch -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)
Il 14.04.09 16:55, "Les Mikesell" ha scritto: > I happen to like openvpn running in peer to > peer mode where you end up with a process and tunnel interface per > instance. OK, so I will take a look at openvpn. Leaving the VPN open is not a problem, of course... Thanks, F. -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)
Boniforti Flavio wrote: >> But, a generic vpn would make life simple. > > I would really *love* to set up a VPN: can you help? I already have VPN > configured on the server (Windows 2003 SBS SP2), I (think) I just need > some command-line linux client, which would open the VPN connection > (DumpPreUserCmd) and having transferred all the data, simply "close the > gate". > > Any suggestions? What's the problem with leaving it up all the time so you can manage the target(s) over it as well as doing backups? You'd normally want your backuppc server to be fairly secure anyway - or you might want to route through a different VPN server handling routes for the whole LANs on each side. If you do need to start and stop it, the technique will depend on the vpn program. I happen to like openvpn running in peer to peer mode where you end up with a process and tunnel interface per instance. So you'd leave the target side up and listening all the time and the backuppc server side would start the program with the relevant config file to open the tunnel and either kill it or "ifconfig down" the tunnel interface to stop it. -- Les Mikesell lesmikes...@gmail.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)
> But, a generic vpn would make life simple. I would really *love* to set up a VPN: can you help? I already have VPN configured on the server (Windows 2003 SBS SP2), I (think) I just need some command-line linux client, which would open the VPN connection (DumpPreUserCmd) and having transferred all the data, simply "close the gate". Any suggestions? TIA, Flavio Boniforti. -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)
Boniforti Flavio wrote: >> Alternatively, set up the tunnel in DumpPreShareCmd instead >> of DumpPreUserCmd. >> Then you will be using a new tunnel for each share. > > May I be using the same TCP ports for it? > That is my only concern right now... As long as the other ssh has gone away and is no longer listening on the local forwarding port you should be able to start another instance. It if is a problem you could wrap the ssh command in a script that sleeps a few seconds first to make sure the previous run has time to close down. But, a generic vpn would make life simple. -- Les Mikesell lesmikes...@gmail.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Have global exclusions stay global?
Craig Barratt wrote: > Oblivian, > > As you point out, there isn't a general method for merging per-client > settings with the global ones. > > However, in 3.2.0beta0 there is a new config variable > $Conf{RsyncArgsExtra} which is combined with $Conf{RsyncArgs}. > The purpose is exactly for your application: you can use > $Conf{RsyncArgs} for the global settings and $Conf{RsyncArgsExtra} > for the per-client settings. > > For excludes you would need to use rsync-type arguments (ie: --exclude) > in $Conf{RsyncArgsExtra}. As a work-around when adding new targets you can use an existing host with the common settings as the template with the NEWHOST=COPYHOST feature so you only have to edit the unique parts. Doesn't help when the global setting change later, though. -- Les Mikesell lesmikes...@gmail.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)
> I have (successfully) been using a script to do this for the > past few months. I copied this from somewhere else (the wiki > perhaps) and have tuned locally since then... > > I created a script in /etc/backuppc/scripts/hostname.sh > #!/bin/bash TERM=vt100 /usr/bin/screen -d -m -S hosttunnel > /usr/bin/ssh -o > ServerAliveInterval=15 -o ServerAliveCountMax=10 -q -x -C -L > 1516:127.0.0.1:873 -l root host > /bin/sleep 20 > > # NOTE: sleep 20? we needed to introduce a small delay to > ensure the tunnel was fully established before rsync started > # NOTE: "-S hosttunnel" helps us identify the process - so we > can kill it when the backups are finished # NOTE: This could > be done with dtach instead of screen # NOTE: the string host > should be replaced with the hostname > > $Conf{ClientNameAlias} = '127.0.0.1'; > $Conf{DumpPreUserCmd}='/etc/backuppc/scripts/host.sh'; > $Conf{DumpPostUserCmd}='/usr/bin/pkill -u backuppc -f host'; > $Conf{RestorePreUserCmd}='/etc/backuppc/scripts/host.sh'; > $Conf{RestorePostUserCmd}='/usr/bin/pkill -u backuppc -f > host'; $Conf{RsyncdClientPort}='1516'; # This 1516 matches > the 1516 in the above script, each tunneled host should use a > unique port number so that parallel backups don't interfere > with each other > > > Hope that helps, if anyone sees something wrong with the > above config, please let me know. I'm interested in understanding how and why it is working in your environment: can you explain? Thanks... -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Not backing up more that first module/directory (rsyncd)
> Alternatively, set up the tunnel in DumpPreShareCmd instead > of DumpPreUserCmd. > Then you will be using a new tunnel for each share. May I be using the same TCP ports for it? That is my only concern right now... -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup remote ftp server (internet site)
HI > The values in your config.pl script appear to be correct. The > "Invalid argument" error is a protocol-level error. I'll need some > more information to figure out what's going on. ok, let's go on! > What ftp server are you running? as i said, that's an internet site; there's a ProFTPD 1.3.0 Server (Debian) used to upload & manage site files. > Have you made any changes to your server configuration lately? I think that no changes were made. > Can you confirm that you can access the > server with a different FTP client? of course (i.e. gftp). > What do the log files for your FTP server look like? i've not ftp server log (not available for me..). Regards M -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/