Re: Number of Files Transferred Seems Wrong

2007-11-27 Thread Jon
Hi All,

This is a continuation of a thread I started some time ago at
http://www.mail-archive.com/rsync@lists.samba.org/msg19852.html

The first occurrence of this problem seems to have just gone away and
all was good for a week or so. I have now seen this same behaviour
again, though.

I'm not sure where the logs went so sadly I cannot provide output from
rsync, but the problem is roughly the same as before in that the
'Number of files trasferred entry provided by the --stats switch is
incorrect.

During testing, I completely removed everything from my testing dir
and then ran an rsync into it from another directory on the same
machine into this directory. When the transfer was complete, I had the
entire /etc /var and /root dirs in my testing directory and the file
space totalled a little over 1GB. The report generated by the --stats
switch showed something like 35,000 files as the Number of files but
only 2 were indicated as transferred under the Number of files
transferred item of the same report.

I know this number is wrong as there was nothing in my testing dir and
now there are the entire contents of the /etc, /var and /root dir, but
I don't know why the Number of files transferred is incorrect.

Can someone shed some light for me on exactly how the 'Number of files
transferred' number is arrived at? Perhaps it's not at cut and dried
as I think.

Thanks

Jon
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Number of Files Transferred Seems Wrong

2007-11-27 Thread Matt McCutchen
On Tue, 2007-11-27 at 10:11 -0400, Jon wrote:
 During testing, I completely removed everything from my testing dir
 and then ran an rsync into it from another directory on the same
 machine into this directory. When the transfer was complete, I had the
 entire /etc /var and /root dirs in my testing directory and the file
 space totalled a little over 1GB. The report generated by the --stats
 switch showed something like 35,000 files as the Number of files but
 only 2 were indicated as transferred under the Number of files
 transferred item of the same report.
 
 I know this number is wrong as there was nothing in my testing dir and
 now there are the entire contents of the /etc, /var and /root dir, but
 I don't know why the Number of files transferred is incorrect.

That is very odd, but I can't do much to troubleshoot it from the
information you gave.  Please repeat this procedure but pass -vvii to
rsync to get more information, and post your command line and the
resulting log.

 Can someone shed some light for me on exactly how the 'Number of files
 transferred' number is arrived at? Perhaps it's not at cut and dried
 as I think.

It is the number of regular files in the file list whose data is
transferred from sender to receiver either in full or using the
delta-transfer algorithm.  Once rsync decides to transfer a file, the
transfer counts even if the data was already identical.  The statistic
includes exactly those files whose itemize codes begin with  or
 (indicating a transfer) in the -i output.

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Number of FIles Transferred Seems Wrong

2007-11-10 Thread Matt McCutchen
On Fri, 2007-11-09 at 12:33 -0400, Jon wrote:
 I'm so confused as to what keeps happening to my subject. I started
 this thread as something like Number of files transferred is wrong
 and the two replies I've received so far have totally different
 subjects.

In the copy of your message that I received and in the archive at
http://lists.samba.org/archive/rsync , the original subject appears as
'Re: Welcome to the rsync mailing list'; perhaps something was wrong
with your email client.  Paul kept that subject in his reply, and in my
reply I changed the subject to something I felt was more meaningful,
rsync retransferring every file, using brackets to indicate that I had
changed the subject.  From now on I'll use the subject you intended.  :)

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Number of FIles Transferred Seems Wrong

2007-11-10 Thread Matt McCutchen
On Fri, 2007-11-09 at 11:29 -0400, Jon wrote:
 One piece of information that I forgot to
 mention in my original post is that the second rsync takes about 3
 seconds. There are no files transferred on the second rsync yet the
 293 are being reported.
 
 If the files were actually being transferred again then I could agree,
 but that's not the case, Rsync seems to be doing exactly what it is
 supposed to be doing. It's just that one stat that doesn't appear to
 jive with anything.

As I see it, it is your claim that rsync is not transferring anything
that does not jive with the Number of files transferred and Matched
data stats and the absence of the -t option.  (Matched data is data
matched by the delta-transfer algorithm in transferred files; files that
are already up to date are counted neither in Literal data nor in
Matched data.)

Does rsync print the names of the 293 files?  If so, it is transferring
them.  For further evidence, pass the -i option; an output line of the
form f..T.. foo means that rsync is transferring () foo because
of a difference in mtime (T).

In any case, the solution is to pass the -t option; if for some reason
you don't want to preserve mtimes, you can use --checksum instead.

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html