Re: rsync: connection unexpectedly closed

2016-10-13 Thread Kip Warner
On Thu, 2016-10-13 at 10:09 +0100, Dave Howorth wrote: > Have you tried excluding the problem file from the transfer? Hey Dave. All the other files appear to sync, up until it gets to that one large file. Then it stalls, and finally times out. I could tell it to exclude that important file, but th

Re: rsync: connection unexpectedly closed

2016-10-13 Thread Kevin Korb
I don't remember whether or not you said you were running rsync over ssh but if you are you can also debug the ssh layer. You can even do it at both ends On the server run a debugging sshd on an alternate port with: /usr/sbin/sshd -dDp222 (note that this will only accept 1 connection, debug t

Re: rsync: connection unexpectedly closed

2016-10-13 Thread Wayne Davison
On Wed, Oct 12, 2016 at 8:30 PM, Kip Warner wrote: > I think the key insight was in the strace log which showed the > select() call was timed out. No, that's totally expected. While select() is waiting for I/O to arrive, it returns to rsync every 60 seconds to allow it to decide if it wants to

[Bug 12378] why i cannot exclude dir/files if using option "--files-from"

2016-10-13 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=12378 Wayne Davison changed: What|Removed |Added Resolution|--- |WORKSFORME Status|NEW

[Bug 12378] why i cannot exclude dir/files if using option "--files-from"

2016-10-13 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=12378 --- Comment #3 from Kevin Korb --- I didn't say anything specific about a remote host. You excluded .cache then you told it to copy specific files some of which are in .cache. If there was a file named .cache inside of a directory that you told i

[Bug 12378] why i cannot exclude dir/files if using option "--files-from"

2016-10-13 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=12378 --- Comment #2 from Alessio --- (In reply to Kevin Korb from comment #1) Excuse me, but i don't get it, what's the difference between excluding (matching) the pattern from a --files-from and a remote host? debugging the rsync transfer from the r

[Bug 12378] why i cannot exclude dir/files if using option "--files-from"

2016-10-13 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=12378 --- Comment #1 from Kevin Korb --- It did not copy the directory you excluded it copied the files within that directory that you explicitly told it to copy and created the appropriate directories to allow that to happen. IOW, .cache is not relativ

[Bug 12378] New: why i cannot exclude dir/files if using option "--files-from"

2016-10-13 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=12378 Bug ID: 12378 Summary: why i cannot exclude dir/files if using option "--files-from" Product: rsync Version: 3.1.2 Hardware: x64 OS: Linux Status:

Re: rsync: connection unexpectedly closed

2016-10-13 Thread Dave Howorth
On 2016-10-10 17:24, Kip Warner wrote: Note that I have temporarily disabled timeouts and added extra verbosity. The transfer to the remote host via SSH works fine, up until it gets to a 30+ GB file (a VM image). It gets about 90+ percent of the way through, hangs, and then times out. I have a