Re: [BackupPC-users] rsyncd resume of partial backup retransmits many files

2009-10-21 Thread Harald Amtmann 
 debian linux running BackupPC 3.1.0, client is Windows XP SP2 with rsync
 3.0.4 (for more details see below). 

 When I retrigger the full backup, a lot of large files are retransmitted

Update: All files are retransmitted: This is a log excerpt of the pc being 
backuped:

2009/10/22 02:16:00 [2244] send [192.168.5.9]  .musikproject/musik_u.db 
28868608 f?

From rsyncs doc this means:
 item transmitted to remote host
f item is a file
? property unknown
...

To cite from the rsync doc:
and (3) an unknown attribute replaces each letter with a ? (this can happen 
when talking to an older rsync)

So I think because of this rsync is retransmitting instead of finding that the 
files didn't change. It doesn't even try to checksum altough the logs on the 
other side indicate that checksums are sent (see previous mail).

Please help! What is wrong here?

Harald


-- 
Jetzt kostenlos herunterladen: Internet Explorer 8 und Mozilla Firefox 3.5 -
sicherer, schneller und einfacher! http://portal.gmx.net/de/go/atbrowser

--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] rsyncd resume of partial backup retransmits many files

2009-10-14 Thread Harald Amtmann 
 I am trying to backup a machine over a low bandwidth connection. Server is
 debian linux running BackupPC 3.1.0, client is Windows XP SP2 with rsync
 3.0.4 (for more details see below). I am currently trying to run the initial
 full backup but it got interrupted twice already due to various reasons.
 When I retrigger the full backup, a lot of large files are retransmitted
 even though they have already been uploaded to the server and weren't even
 touched in the meantime.

To clarify: It seems rsync is uploading some of the previously uploaded files 
to the server again (see the log for one such a file in my previous mail). 
After the upload finished, backuppc determines that the hash is the same, 
detects the file to be in the pool already and goes to the next file. It does 
this for a whole lot of files. The first backup run was interrupted after about 
9 hours. When I restarted it, after about 5 hours it was still 
reuploading/rechecking files which have been uploaded in the first run.

Can anyone tell me what _should_ happen in this case? Maybe I didn't understand 
the workings of backuppc right and what I see is totally normal.


Thanks
-- 
GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01

--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] rsyncd resume of partial backup retransmits many files

2009-10-12 Thread Harald Amtmann 
Hello,

I am trying to backup a machine over a low bandwidth connection. Server is 
debian linux running BackupPC 3.1.0, client is Windows XP SP2 with rsync 3.0.4 
(for more details see below). I am currently trying to run the initial full 
backup but it got interrupted twice already due to various reasons. When I 
retrigger the full backup, a lot of large files are retransmitted even though 
they have already been uploaded to the server and weren't even touched in the 
meantime. 

In the log excerpt below you can see the processing of a file that definitely 
has been uploaded already. I am not sure if rsync transmits the file completely 
again or if the blocksize is so very small that the blockhashes are almost as 
much data as the original file. Whatever it is, resuming takes wy too long.

Is it a problem to use rsyncd and pool compression in this scenario? Please 
help.

Regards,
Harald


Windows XP Client
-

rsync  version 3.0.4  protocol version 30
Copyright (C) 1996-2008 by Andrew Tridgell, Wayne Davison, and others.
Web site: http://rsync.samba.org/
Capabilities:
64-bit files, 64-bit inums, 32-bit timestamps, 64-bit long ints,
socketpairs, hardlinks, symlinks, no IPv6, batchfiles, inplace,
append, ACLs, no xattrs, iconv, symtimes

rsyncd.conf
---

[d]
path = /cygdrive/d
comment = Documents and Settings
strict modes = false
auth users = baggub
secrets file = D:/Programme/develop/cygwin/etc/rsyncd.secrets
hosts allow = 192.168.5.9
read only = true
list = false



Debian Linux Server Log
---


full backup started for directory docsnsettings
Connected to therapy:873, remote version 30
Negotiated protocol version 28
Got response: 96c536dccfe269b730e0053c0bfd0561
in mime: lsU23M/iabcw4AU8C/0FYQ
Auth: got challenge: lcPTIMTn7tfds46eQF+PFw, reply: baggub 
lsU23M/iabcw4AU8C/0FYQ
Connected to module docsnsettings
Sending args: --server --sender --numeric-ids --perms --owner --group -D 
--links --hard-links --times --block-size=2048 --recursive --ignore-times . .
Checksum seed is 1255314593
Got checksumSeed 0x4ad294a1
[..]
Got file (244 of 387): .kde/share/apps/amarok/collection.db
[..]
/var/lib/backuppc/pc/therapy/0/fdocsnsettings/f.kde/fshare/fapps/famarok/fcollection.db
 cache = , invalid = , phase = 0
Sending csums for .kde/share/apps/amarok/collection.db (size=6002688)
[..]
Starting file 191 (.kde/share/apps/amarok/collection.db), blkCnt=2931, 
blkSize=2048, remainder=2048
.kde/share/apps/amarok/collection.db: blk=, newData=4096, rxMatchBlk=0, 
rxMatchNext=0
.kde/share/apps/amarok/collection.db: blk=2099, newData=0, rxMatchBlk=0, 
rxMatchNext=0
.kde/share/apps/amarok/collection.db: blk=3, newData=0, rxMatchBlk=2099, 
rxMatchNext=2100
.kde/share/apps/amarok/collection.db: blk=, newData=7168, rxMatchBlk=3, 
rxMatchNext=4
.kde/share/apps/amarok/collection.db: blk=2097, newData=0, rxMatchBlk=, 
rxMatchNext=4
.kde/share/apps/amarok/collection.db: blk=2099, newData=0, rxMatchBlk=2097, 
rxMatchNext=2098
.kde/share/apps/amarok/collection.db: blk=, newData=23552, rxMatchBlk=2099, 
rxMatchNext=2100
[...]
rxMatchNext=2100
.kde/share/apps/amarok/collection.db: blk=, newData=30720, rxMatchBlk=, 
rxMatchNext=2100
.kde/share/apps/amarok/collection.db: blk=, newData=0, rxMatchBlk=, 
rxMatchNext=2100
.kde/share/apps/amarok/collection.db got digests 
79fcd46f9cecf0e252718c1c0959dd2c vs 79fcd46f9cecf0e252718c1c0959dd2c
  pool 700 4294967295/4294967295 6002688 
.kde/share/apps/amarok/collection.db
attribSet(dir=fdocsnsettings/.kde/share/apps/amarok, file=collection.db, 
size=6002688, placeholder=)

-- 
GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01

--
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay 
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/