rsync error when sending lot's of small files

2007-11-15 Thread Johan Huysmans

Hi All,

I have a problem when transferring files from a rsyncd.  This is my setup:
* server: runs rsyncd on port 873.
* firewall: forwarding for the 873 port from outside (using SNAT and DNAT).
* client: manually running rsync command using modules.

The problem occurs when lots of small identical files are being send.
Small is smaller than 400 bytes.

It also only occurs when the NATting happens, running it locally give no 
problems.


Also when i use the --sockopts=SO_SNDBUF=xxx argument on the rsyncd it 
won't occur, but i noticed that the transfer is generally slower. (I 
also have normal sizes files available)


I hope someone call help me or point me to the right direction.

Greetings Johan Huysmans
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error when sending lot's of small files

2007-11-15 Thread Fabian Cenedese
At 11:57 15.11.2007 +0100, you wrote:
>Hi All,
>
>I have a problem when transferring files from a rsyncd.  This is my setup:

What is the error you get?

bye  Fabi


-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error when sending lot's of small files

2007-11-15 Thread Johan Huysmans

whoops forgot to mention the error i receive ;)

This message appears on the client side:
rsync: writefd_unbuffered failed to write 4092 bytes [generator]: 
Connection reset by peer (104)
rsync error: error in rsync protocol data stream (code 12) at io.c(1122) 
[generator=2.6.9]

rsync error: received SIGUSR1 (code 19) at main.c(1182) [receiver=2.6.9]

Fabian Cenedese wrote:

At 11:57 15.11.2007 +0100, you wrote:
  

Hi All,

I have a problem when transferring files from a rsyncd.  This is my setup:



What is the error you get?

bye  Fabi


  

--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error when sending lot's of small files

2007-11-28 Thread Johan Huysmans

I noticed it is working with the rysnc-3.0.0-pre5, or at least the protocol
of it. Is it possible to use that protocol for the curren stable release.

Greetings Johan



Johan Huysmans wrote:
> 
> whoops forgot to mention the error i receive ;)
> 
> This message appears on the client side:
> rsync: writefd_unbuffered failed to write 4092 bytes [generator]: 
> Connection reset by peer (104)
> rsync error: error in rsync protocol data stream (code 12) at io.c(1122) 
> [generator=2.6.9]
> rsync error: received SIGUSR1 (code 19) at main.c(1182) [receiver=2.6.9]
> 
> Fabian Cenedese wrote:
>> At 11:57 15.11.2007 +0100, you wrote:
>>   
>>> Hi All,
>>>
>>> I have a problem when transferring files from a rsyncd.  This is my
>>> setup:
>>> 
>>
>> What is the error you get?
>>
>> bye  Fabi
>>
>>
>>   
> -- 
> To unsubscribe or change options:
> https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
> 
> 

-- 
View this message in context: 
http://www.nabble.com/rsync-error-when-sending-lot%27s-of-small-files-tf4811248.html#a13989618
Sent from the Samba - rsync mailing list archive at Nabble.com.

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error when sending lot's of small files

2007-11-28 Thread Matt McCutchen
On Wed, 2007-11-28 at 02:29 -0800, Johan Huysmans wrote:
> I noticed it is working with the rysnc-3.0.0-pre5, or at least the protocol
> of it. Is it possible to use that protocol for the curren stable release.

No, the protocol is new in rsync-3.0.0* .

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html