Re: Batch mode creates huge diffs, bug(s)?

2012-03-21 Thread Matt Van Mater
OK so I re-ran rdiff with several different block sizes against my two image files described earlier to try and find the optimal size with my use case. Here is a summary: 64 byte block - signature size: 3199208028, delta size: 543335307 256 byte block - signature size: 799802016, delta

Re: Batch mode creates huge diffs, bug(s)?

2012-03-21 Thread Matt Van Mater
OK, I think I found the source of my problem... One bug I found is due to the very large size of the file I am transferring (16993256652 image2 -- 17062442700 image1) combined with specifying a small-ish block size (512). The other bug I am unsure of the cause. 1. Example 1 (works, but

Re: Batch mode creates huge diffs, bug(s)?

2012-03-20 Thread ericbambach1
Van Mater matt.vanma...@gmail.com To: rsync@lists.samba.org Date: 03/20/2012 12:55 PM Subject:Batch mode creates huge diffs, bug(s)? Sent by:rsync-boun...@lists.samba.org So the short summary of my problem is, the batch file rsync creates is HUGE for a very small change

Re: Batch mode creates huge diffs, bug(s)?

2012-03-20 Thread Joachim Otahal (privat)
Matt Van Mater schrieb: image1 size in bytes: 17,062,442,700 image2 size in bytes: 16,993,256,652 about 70 MB of change between a boot with a small program install. That is realistic.

Re: Batch mode creates huge diffs, bug(s)?

2012-03-20 Thread Matt Van Mater
, Riverwoods IL 60015 P: 224.405.2896 ericbamba...@discover.com From: Matt Van Mater matt.vanma...@gmail.com To: rsync@lists.samba.org Date: 03/20/2012 12:55 PM Subject:Batch mode creates huge diffs, bug(s)? Sent by:rsync-boun...@lists.samba.org So the short summary of my

Re: Batch mode creates huge diffs, bug(s)?

2012-03-20 Thread Joachim Otahal (privat)
Matt Van Mater schrieb: Alternate assessment - I ran a similar comparison against the two image files using rdiff that comes with Ubuntu 10.04.4 LTS (shown up as librsync 0.9.7) and have a significantly smaller delta file (closer to what i expect). Just plain luck. If ubuntu wrote the most

Re: Batch mode creates huge diffs, bug(s)?

2012-03-20 Thread Matt Van Mater
Let me restate my last email regarding rdiff: All of my image files are from the same Windows XP VM, created using FOG/partimage. Image1 is the baseline, Image2 is Image1 + the WinSCP binary downloaded (not even installed). I am not imaging an Ubuntu machine. I am using the Ubuntu machine as a

Re: Batch mode creates huge diffs, bug(s)?

2012-03-20 Thread Joachim Otahal (privat)
Matt Van Mater schrieb: Let me restate my last email regarding rdiff: All of my image files are from the same Windows XP VM, created using FOG/partimage. Image1 is the "baseline", Image2 is Image1 + the WinSCP binary downloaded (not even installed).

Re: Batch mode creates huge diffs, bug(s)?

2012-03-20 Thread Matt Van Mater
I ran one more test on a separate VM to check and see if rsync would allow me to specify block size for a smaller file while using batch mode... it works. To me that indicates that rsync has a problem processing very large batch files, especially when you specify a particular block size. More