how to Monitoring rsync Server
i want store ip of client pre connection and transfer time pre connection how to Monitoring rsync Server? -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Possibility to run rsync without hash table lookups
Hi All I am using rsync to do a local network copy of 10 ~8gig files. The source is a NAS Atom rsync server, and the destination is a cygdrive, obviously on the same computer that is running rsync client. I am using --inplace, and ingeneral, the 8gig files generally have data changed within the file, but the general structure of the file is not changed. They are Firebird databases. (The total daily binary difference, that which is sent over the wire, is usually about 300meg for 8gig file) I am looking at ways to improve the performance. What I have noticed is the following: 1) RSync checks that the file needs updating 2) It runs through the file on the client (8gig read on the client, quite quick) 3) Client and server now start running through the file. But this is slow, CPU limits this to 10megs/s Presumably, the CPU is getting thrashed because it is performing hash table lookups. Is it possible to disable hash table look ups, but still have the MD5 block comparison? So, in step 3, both the client and server run through the file, and send each other MD5 block comparisons, and simply transfer the whole block if needed, instead of doing a hash table lookup? I have tried --append and --append-verify, but my data is not strictly append-only data When I used --append-verify, it confirmed that the Atom server it quite capable of chewing through a large file and generating checksums. If I am correct, I think it would be a nice feature for RSync, to just do block comparison, combined with the '--inplace' feature. Fantastic stuff. Cheers Michael. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: how to Monitoring rsync Server
Check out transfer logging It will log all communication on the rsync server On Wed, Jul 20, 2011 at 4:32 PM, alan fei lxf9...@gmail.com wrote: i want store ip of client pre connection and transfer time pre connection how to Monitoring rsync Server? -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
FATAL I/O ERROR: dying...
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hello, Local rsync version 3.0.7 protocol version 30. The remote rsync version is 3.0.5, I think. opensuse v11.3 linux 2.6.34.8-0.2-desktop x86_64 The nightly rsync run is getting this error: 2011/07/20 02:04:29 [17840] FATAL I/O ERROR: dying to avoid a \ --delete-during issue with a pre-3.0.7 receiver The options are: - --archive --stats --compress --delete --itemize-changes What is needed to prevent the FATAL I/O ERROR? - -- James Moe moe dot james at sohnen-moe dot com 520.743.3936 -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.15 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk4nBmoACgkQzTcr8Prq0ZPldgCfVGflkUgtk/R0SytX7VywZ0+u LRgAnjUWpapFKdOTEM0Y1AWDUDRC1mlz =BEOc -END PGP SIGNATURE- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: FATAL I/O ERROR: dying...
In 4e27066a.4080...@sohnen-moe.com, on 07/20/11 at 09:46 AM, James Moe ji...@sohnen-moe.com said: The nightly rsync run is getting this error: 2011/07/20 02:04:29 [17840] FATAL I/O ERROR: dying to avoid a \ --delete-during issue with a pre-3.0.7 receiver The options are: - --archive --stats --compress --delete --itemize-changes What is needed to prevent the FATAL I/O ERROR? Add --delete-before or --delete-after. --delete defaults to --delete-during. Steven -- -- Steven Levine stev...@earthlink.net eCS/Warp/DIY etc. www.scoug.com www.ecomstation.com -- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
