[BackupPC-users] win32 rsyncd speed
G'evening all. Does anyone know of a good way to speed up rsyncd on a Windows machine? I'm doing remote backups, from Windows servers on a 100Mb/s link to a Tier1 provider, to my BackupPC off-site location on Verizon FiOS. It seems to be taking an awful long time to get the data down to me. I just started doing them a few days ago. The only server with a transfer rate says the speed was 0.13 MB/s I just did an scp of a 45Mb file from a server in the same location, to my backup machine. scp reported 935KB/s, taking 49 seconds. 0.13 and 0.93 are a world of difference. I'm assuming there's something in the rsyncd configuration I could change, but there wasn't a lot of documentation in the rsyncd package. I'm using the one from the BackupPC site, not my own compile. - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] How to Troubleshoot BackupPC
John writes: > I recently bumped up the log level to 8 and I noticed something else didn't > look right. > The first is what a lot of the initial files look like, after though they > start to look like the second example with the > "size doesn't match (< file size> vs 0) > > Example 1 > --- > My Wallpapers/Default.wallpaper: blk=, newData=0, rxMatchBlk=0, > rxMatchNext=1 > MD4 /backup/BackupPC/data/pc/aegis/0/fTest/fMy Wallpapers/fDefault.wallpaper > cache = , invalid = > My Wallpapers/Default.wallpaper got exact match > My Wallpapers/Default.wallpaper got digests e85fc0462aa62f6bc03d21366b28672f > vs e85fc0462aa62f6bc03d21366b28672f > My Wallpapers/Default.wallpaper: nothing to do > > Example 2 > --- > Sending empty csums for My Wallpapers/Landscape.wallpaper > > -- > Starting file 1983 (My Wallpapers/Landscape.wallpaper), blkCnt=0, > blkSize=2048, remainder=0 > My Wallpapers/Landscape.wallpaper: size doesn't match (1123 vs 0) > My Wallpapers/Landscape.wallpaper: blk=, newData=1123, rxMatchBlk=, > rxMatchNext=0 > My Wallpapers/Landscape.wallpaper: blk=, newData=0, rxMatchBlk=, > rxMatchNext=0 > My Wallpapers/Landscape.wallpaper got digests > 60b7cc422ec840e0b35afc4e47b63d94 vs 60b7cc422ec840e0b35afc4e47b63d94 > [ skipped 1 lines ] > attribSet(dir=fTest/My Wallpapers, file=Landscape.wallpaper) > > Does anyone know if this is a problem and what the cause could be. Any > specific things to look for when troubleshooting would also be useful. These messages appear to be normal. The first case is a file that hasn't changed. The second case is a file that is size 0 on the prior backup (or didn't exist), and the new file is 1123 bytes. That file gets transferred as literal data. The final digest check confirms that data was sent correctly. Back to your original problem, I'm not sure what the transfer ends with an error. It appears to be ending normally. Can you email me a complete XferLOG file offlist? Craig - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] No
Krsnendu writes: > BackupPC says the backup was successful but nothing is backed up and > when I try to browse backups it says: > > Error: Backup number for host nendu does not exist. > > This is the log. > > 2006-12-12 15:25:19 full backup 0 complete, 6 files, 268508 bytes, 0 > xferErrs (0 bad files, 0 bad shares, 0 other) > 2006-12-12 15:27:47 full backup started for directory test > > Any tips? Questions: - Which version of BackupPC are you running? - Does the completed backup appear in the host list? If so, what happens when you click on the "0" link? If not, what is in the DATADIR/pc/nendu/backups file? Might be a permissions problem, but I'm not sure. Or are you running apache on a different machine to the BackupPC server? Craig - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
[BackupPC-users] rsync error ssh_askpass w/ cygwin
Hello all! I found some mails in the archive that relates to this problem, but what seemed to be the solution didn't work for me. I'd like to show what's happening, and hope to get some input on what the problem is. Here is the info I found in the archives: http://sourceforge.net/mailarchive/message.php?msg_id=11630857 - Sam Przyswa writes: > I had a BackupPC 2.1.0 version running fine on a machine, I installed a > new machine with the 2.1.1 version, copy all my setup machine > ./pc//config.pl files create the .ssh/authorized_keys, then when I > try to backup machine with the "rsync" i got now the error: > > Fatal error (bad version): ssh_askpass: exec(/usr/bin/ssh-askpass): No > such file or directory > > The "rsyncd" work fine on the same machine. > > I never got that before !? > > Thanks in advance for your help. Obviously this is a problem with the ssh setup. When BackupPC_dump tries to run ssh, instead of the getting the rsync version number instead it gets this string: ssh_askpass: exec(/usr/bin/ssh-askpass): No such file or directory Perhaps you have to manually run ssh as the backuppc user to accept the remote system"s identity. Craig --- Craig's answer seemed true enough, simply that one of the pair of machines involved in the ssh session didn't have the fingerprint of the other machine stored. I am in the process of switching a backup from using smbclient to rsync, as it is taking greater than 72 hours to perform a backup. The backuppc is running debian stable, backuppc v 2.1.1, and the client machine is windows server 2003 with cygwin on it. I have preshared the ssh key from the server to the client, and it is able to ssh in without any questions: mailbox:~$ whoami backuppc mailbox:~$ ssh -l Administrator 192.168.3.1 Last login: Thu Dec 7 22:28:10 2006 from 192.168.2.1 [EMAIL PROTECTED] ~ $ Obviously that goes through cleanly, and I can reverse the process too: [EMAIL PROTECTED] ~ $ ssh -l backuppc 192.168.2.1 Password: Linux mailbox 2.6.12.4-take1 #1 Tue Oct 18 14:34:24 EDT 2005 i686 GNU/Linux The programs included with the Debian GNU/Linux system are free software; the exact distribution terms for each program are described in the individual files in /usr/share/doc/*/copyright. Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent permitted by applicable law. You have mail. Last login: Thu Dec 7 22:28:42 2006 from mas90-server [EMAIL PROTECTED]:~$ Going from client to server does ask for a password, but that shouldn't be a problem, as ssh is never used in that direction. Here is the problem when I try to run a rsync backup: Running: /usr/bin/ssh -q -x -l Administrator mas90-server /usr/bin/rsync --server --sender --numeric-ids --perms --owner --group --devices --links --times --block-size=2048 --recursive --include=/cygdrive --include=/cygdrive/f --include=/cygdrive/f/UPC --include=/cygdrive/g --include=/cygdrive/g/apps --exclude=/\\\* --exclude=/cygdrive/\\\* --exclude=/cygdrive/f/\\\* --exclude=/cygdrive/g/\\\* . / Xfer PIDs are now 11104 Rsync command pid is 11104 Got remote protocol 1600680819 Fatal error (bad version): ssh_askpass: exec(/usr/bin/ssh-askpass): No such file or directory Checksum seed is 1886090081 Got checksumSeed 0x706b7361 Can't write 151 bytes to socket Sent include: /cygdrive Sent include: /cygdrive/f Sent include: /cygdrive/f/UPC Sent include: /cygdrive/g Sent include: /cygdrive/g/apps Sent exclude: /* Sent exclude: /cygdrive/* Sent exclude: /cygdrive/f/* Sent exclude: /cygdrive/g/* fileListReceive() failed Done: 0 files, 0 bytes Got fatal error during xfer (fileListReceive failed) Backup aborted by user signal So after my longwinded buildup (sorry), it seems to me that the ssh requirements are met, yet for some reason I still get rsync complaining about ssh-askpass, which it doesn't seem like it should need. Please let me know if you need any additional info! Thanks also for a great piece of software! - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
[BackupPC-users] No
BackupPC says the backup was successful but nothing is backed up and when I try to browse backups it says: Error: Backup number for host nendu does not exist. This is the log. 2006-12-12 15:25:19 full backup 0 complete, 6 files, 268508 bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other) 2006-12-12 15:27:47 full backup started for directory test Any tips? - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] 555 errors: Unable to read 65536 bytes from
David writes: > Two days in a row I got 555 lines of error that are all the same for > both days: > > Unable to read 65536 bytes from /home/backuppc/pc/mail/new//f%2f/RStmp got=0, > seekPosn=402653184 (0,4,24581,401604608,402727821) > > The curious thing is that the size is exactly 64k. And every line > of error is the same for two days. I looked at the system logs > and there were no errors. Where is this error comming from? Is > it a media error? Is it on the client? The server? Is it a bug > in backuppc? Several people have reported this, so this makes it more likely it is a bug in BackupPC. I would like to replicate it. This happens in a part of the BackupPC::Xfer::RsyncFileIO code where a large file has deltas (changes). Since the file is large it is uncompressed to disk in the RStmp file, and that file is then read to process the deltas as the new updated file is generated and written to disk. Let me look at the code and I'll get back to you offline with some debugging suggestions. Craig - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC 3.0, rsyncd and UTF-8 support?
Tomasz writes:
> Craig Barratt wrote:
> >
> > Rsync uses the native client charset coding (ie: it doesn't change
> > anything).
> > On a windows machine that is typically cp1250.
> >
> > BackupPC 3.0 uses utf8 on the server and can optionally translate
> > to/from the client charset coding by setting $Conf{ClientCharset},
> > eg:
> >
> > $Conf{ClientCharset} = 'cp1250';
> >
> > In western europe you might need to use cp1252.
> >
> > Unlike rsync, samba by default converts to/from utf8, so there is
> > no need to have BackupPC 3.0 do any conversion for smb.
>
> Still, it doesn't work perfectly well for me.
> Windows machine is a 2003, German version. It mostly has filenames in
> German, so setting ClientCharset to cp1252 works well for German characters.
>
> There are also filenames written for example in Russian or Greek, or
> some other languages not covered by "cp1252".
> In such cases, I get info that the "file has vanished", which is not
> really true.
>
> Is there a setting that will cover all languages?
> The files in question can be read just fine on the Windows 2003 server.
This is a long-standing issue in cygwin or WinXX, not related to BackupPC.
The problem is that the sequence of bytes returned when a directory is
read by rsync on cygwin don't allow you to open the file when you call
open() with that same sequence of bytes. So rsync reports the file as
vanished, since it can't open it after reading the directory to get the
file name.
You can google for "file has vanished rsync cygwin". One example thread
is:
http://lists.samba.org/archive/rsync/2006-May/015411.html
Craig
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/
Re: [BackupPC-users] How to Troubleshoot BackupPC
I recently bumped up the log level to 8 and I noticed something else didn't
look right.
The first is what a lot of the initial files look like, after though they
start to look like the second example with the
"size doesn't match (< file size> vs 0)
Example 1
---
My Wallpapers/Default.wallpaper: blk=, newData=0, rxMatchBlk=0,
rxMatchNext=1
MD4 /backup/BackupPC/data/pc/aegis/0/fTest/fMy Wallpapers/fDefault.wallpaper
cache = , invalid =
My Wallpapers/Default.wallpaper got exact match
My Wallpapers/Default.wallpaper got digests e85fc0462aa62f6bc03d21366b28672f
vs e85fc0462aa62f6bc03d21366b28672f
My Wallpapers/Default.wallpaper: nothing to do
Example 2
---
Sending empty csums for My Wallpapers/Landscape.wallpaper
--
Starting file 1983 (My Wallpapers/Landscape.wallpaper), blkCnt=0,
blkSize=2048, remainder=0
My Wallpapers/Landscape.wallpaper: size doesn't match (1123 vs 0)
My Wallpapers/Landscape.wallpaper: blk=, newData=1123, rxMatchBlk=,
rxMatchNext=0
My Wallpapers/Landscape.wallpaper: blk=, newData=0, rxMatchBlk=,
rxMatchNext=0
My Wallpapers/Landscape.wallpaper got digests
60b7cc422ec840e0b35afc4e47b63d94 vs 60b7cc422ec840e0b35afc4e47b63d94
[ skipped 1 lines ]
attribSet(dir=fTest/My Wallpapers, file=Landscape.wallpaper)
Does anyone know if this is a problem and what the cause could be. Any
specific things to look for when troubleshooting would also be useful.
Thanks
John
-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of John
Cianfarani
Sent: Monday, December 11, 2006 2:48 AM
To: backuppc-users@lists.sourceforge.net
Subject: Re: [BackupPC-users] How to Troubleshoot BackupPC
I tried to start the backup manually as suggested but still could not notice
a glaring error. (I have also tried to rerun backups to see if I get the
same error)
It goes through the "Got File" phase and counts up to the total number of
files.
Then it goes through the sending csums phase and the sending hashes phase.
This seems to look strange almost like it failed the ping check or
something??? Below it says it got done/exit from child and done that it got
3494 files the exact amount...
Finished deltaGet phase 0
Child is sending done
Got done from child
Finished deltaGet phase 1
Got stats: 2109251 1639372 930763695 0 ('errorCnt' => 0,'ExistFileSize' =>
930763695,'ExistFileCnt' => 3494,'TotalFileCnt' => 3494,'
ExistFileCompSize' => 501763531,'TotalFileSize' => 930763695)
attribWrite(dir=fTest) -> /backup/BackupPC/data/pc/aegis/new/fTest/attrib
attribWrite(dir=) -> /backup/BackupPC/data/pc/aegis/new//attrib
Got exit from child
Done: 3494 files, 930763695 bytes
(Omitted long ping check results(
CheckHostAlive: returning 14.820
Backup aborted ()
dump failed:
link aegis
Again any help is appreciated.
Thanks
John
-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Tomasz
Chmielewski
Sent: Friday, December 08, 2006 10:44 AM
Cc: backuppc-users@lists.sourceforge.net
Subject: Re: [BackupPC-users] How to Troubleshoot BackupPC
John Cianfarani wrote:
> Hello All,
>
>
>
> I'm been testing BackupPC for awhile now (currently trying Beta3) and
> I'm having some troubles with Rsyncd backups on windows machine. I have
> 2 BPC machines setup for testing one at home and one in a remote colo
> location. If I backup a WinXP machine at my home (just a test directory
> with about 3500 files and directories approx 900meg) it works and
> completes fine. When I try the same backup from the colo location it
> seems to always fail. When I check the host status it's listed as a
> partial backup but it has the correct number of files and the size looks
> right. I have turned XferLogLevel to 5 but I cannot find any reason in
> the error file or the log file for the error. The only thing I see is
> 'Got exit from child' I'm not even sure if that is a bad thing. Any
> advice on what might the cause of this problem is most welcome.
>
>
>
> Some Relevant Settings:
>
> ---
>
> PingMaxMsec = 500 (Colo peers with my provider so pingtimes are very low)
>
> Compression = 3
>
> ClientTimeout = 72000 (Always seems to complete well within this time)
>
> BackupZeroFilesisFatal = 0
Did you try to start the backup manually?
You will see the errors should there be any...
backuppc$ /srv/backuppc/bin/BackupPC_dump -v -f destination_machine
--
Tomasz Chmielewski
http://wpkg.org
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/
-
Re: [BackupPC-users] Child Exited Prematurely
On Sun, 2006-12-10 at 19:55 -0500, Randy Barlow wrote: > Howdy, I am seeing on one of my machines the "Child exited prematurely" > error. > It's BackupPC 2.1.2pl2 and the bizarre thing is that there are no further > errors (logs are empty). What does this mean? (I am using RsyncD as > transport method and backing up a Linux host). Well it turns out that the partition was full, and so there wasn't any space to write the data. But it took me forever to notice that!!! R - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] How to disable backups on weekend days ?
Julien HASCOET wrote:
Hello,
Does anyone knows how to disable backups during weekends (saturday and
sunday) ?
I have tried this :
$Conf{BlackoutPeriods}
= [
{ hourBegin => 7.0,
hourEnd => 19.5,
weekDays => [1, 2, 3, 4, 5],
},
{ hourBegin => 1,
hourEnd => 23,
weekDays => [6, 0],
},
];
but it doesn't worked !
Thanks for any response ...
Your halfway there.
do this also
$Conf{BlackoutGoodCnt} = 0;
$Conf{BlackoutBadPingLimit} = 3;
That makes sure the blackout period gets enforced.
Regards,
Les
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/
[BackupPC-users] How to disable backups on weekend days ?
Hello,
Does anyone knows how to disable backups during weekends (saturday and
sunday) ?
I have tried this :
$Conf{BlackoutPeriods}=
[
{ hourBegin => 7.0,
hourEnd => 19.5,
weekDays => [1, 2, 3, 4, 5],
},
{ hourBegin => 1,
hourEnd => 23,
weekDays => [6, 0],
},
];
but it doesn't worked !
Thanks for any response ...
Julien.
-
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/
Re: [BackupPC-users] auth required, but service test is open/insecure...
Krsnendu dasa wrote: > I changed the permission of /home/krsnendu/test/ and contents to allow > read and enter access. Now it backs up. How can I set it up so that it > can back up any file. Do I have to setuid=root or something? > > > perhaps you can make the backup user belong to a group, say "backup" and use setgid instead. Then set permissions on a group level to suit. Regards, Les - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
