rsync+cygwin 1.5-1.7 performance
Hi Has anybody ever made comparisons about the performance of cygwin 1.7 compared to 1.5? I believe there were some changes that should make it faster, but I don't know if they affect rsync too. Thanks bye Fabi -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 6378] rsync -v -rsync -v --inplace --progress --rsh=ssh -a reports erroneous and completely unrealistic transferred size
https://bugzilla.samba.org/show_bug.cgi?id=6378 shlo...@iglu.org.il changed: What|Removed |Added Status|RESOLVED|REOPENED Resolution|INVALID | --- Comment #2 from shlo...@iglu.org.il 2009-05-20 03:08 CST --- Hi! (In reply to comment #1) As stated in the man page description of --progress, the size shown is the amount of the file reconstructed by the receiver so far. I'm guessing the receiver already had the correct first 2129920 bytes of the file from a previous run, That's not true - it's a brand-new transfer. And ls -l on the file in the remote end does not show nearly as much (as expected from my connection). so the delta-transfer algorithm verifies quickly that those 2129920 bytes match the beginning of the source file and the size jumps to 2129920. Well, it's not what happens in this case. From that point on, literal data has to be sent, so progress is slower. I'm re-opening this bug, because your explanation was not true. Sorry for not stating earlier that this was a brand new transfer. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync+cygwin 1.5-1.7 performance
For me, cygwin 1.7 make rsync usable on Windows. Although hacking with the UTF-8 dll, cygwin 1.5 limited paths (or file names) to 256 characters. This limitation was too much for me since I use it to backup user data that can be longer than this. I've read on cygwin list about performance improvements, but since I could not use 1.5 (without modified dll), I can't compare. And I think that most of people that use (or tried) this solution will agree that passing this 256 char limitation worth, by itself, the Champagne :) I don't use cygwin directly but cwrsync (update 400, based on 1.7 beta with patches + rsync http://www.itefix.no/i2/node/11649 ). I can say performances are good. In a client (win xp)/server (freenas) setup over 100Mb network it takes less than a minute to do a sync of a 6 GB directory with lots of small files when there is no changes. Of course, if there are changes, the time depends of the amount of changes, so it's difficult to report performance. But I'm happy of this solution. Regards, Vitorio Le 20 mai 09 à 08:59, Fabian Cenedese a écrit : Hi Has anybody ever made comparisons about the performance of cygwin 1.7 compared to 1.5? I believe there were some changes that should make it faster, but I don't know if they affect rsync too. Thanks bye Fabi -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
2.6.9 and 3.0.5 sync error
Dear List, I'm using rsync to sync my data, see below command. And I met this error? I think it might be due to 2.6.9 and 3.0.5 compatible issue. So how to solve the problem? Thanks. rsync -vrtopg --progress --delete --password-file=rsync-password /path/on/pc r...@192.168.0.202::destination building file list ... 151804 files to consider rsync: push_dir#1 / (in maps) failed: Permission denied (13) rsync error: errors selecting input/output files, dirs (code 3) at main.c(486) [receiver=2.6.9] rsync: connection unexpectedly closed (4 bytes received so far) [sender] rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.5] -- Daniel -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: 2.6.9 and 3.0.5 sync error
This seems for me an autorisation problem rsync: push_dir#1 / (in maps) failed: Permission denied (13) Verify that you have enough privileges to read the data you are trying to. Le 20 mai 09 à 13:01, Daniel.Li a écrit : Dear List, I'm using rsync to sync my data, see below command. And I met this error? I think it might be due to 2.6.9 and 3.0.5 compatible issue. So how to solve the problem? Thanks. rsync -vrtopg --progress --delete --password-file=rsync-password /path/on/pc r...@192.168.0.202::destination building file list ... 151804 files to consider rsync: push_dir#1 / (in maps) failed: Permission denied (13) rsync error: errors selecting input/output files, dirs (code 3) at main.c(486) [receiver=2.6.9] rsync: connection unexpectedly closed (4 bytes received so far) [sender] rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.5] -- Daniel -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --fuzzy question
On Wed, May 20, 2009 at 2:26 AM, Julian Pace Ross li...@prisma.com.mt wrote: Thanks Ryan! In fact I found it's a combination of factors you mentioned... i.e. a compressed SQL .bak file, so contrary to what I thought, the fuzzy file was indeed being found but no matches were being found in the file... thanks again for the info. If you have the disk space at both ends, I would suggest doing what I do for SQL backup synchronization. 1) Write *uncompressed* .bak files for your databases (with timestamps in the file name, such as those produced by the database maintenance plan engine). This enables the use of --fuzzy, as you have discovered. 2) use Rsync to transfer the uncompressed files, but with the -z option enbaled. This compresses the data over the wire, but decompresses it at the receiving end. 3) Adjust the rsync block size to something smaller if necessary to find more matches. I basically went down to 32KB rsync blocks for one 15 GB database file (rsync would by default use something like 129KB on a file this big). This eats up a lot more CPU, but if irsync can still output data faster than your network connection can handle, it is the most time-efficient way to go. Use multiples of 8KB, as that is the internal page size inherent in MS SQL Server databases. Trial and error is your friend here. Run rsyc with low priority (START /LOW rsync.exe) so the CPU usage doesn't impact SQL Server. 4) Minimize any jobs you have to automatically rebuild indexes. Use UPDATE STATISTICS instead on a daily basis, and rebuild only when index fragmentation gets heavy. There are lots of scripts out there on the net which will automate that for you. 5) Minimize the rebuilds of denormalized reporting tables or other non-essential data. Move these off into other databases that you don't replicate if possible. 6) Watch out for non-sequential clustered indexes. We use GUIDs for primary keys on many tables, and this causes updates and inserts to be spread randomly throughout the table as it is physically stored. Even channging just 5% of the data can result in a change to every database page in such a scenario). Hot tables which use emails or other VARCHAR fields as clustered index keys also result in similar behavior. Most of these suggestions would apply for rsyncing any sort of database backup file... Exchange, PostgreSQL, Oracle, or even (horror!) MySQL. -- RPM -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: 2.6.9 and 3.0.5 sync error
On Wed, 2009-05-20 at 15:35 +0200, Mac User FR wrote: This seems for me an autorisation problem rsync: push_dir#1 / (in maps) failed: Permission denied (13) Verify that you have enough privileges to read the data you are trying to. I have tried root privilege on the both side :( Le 20 mai 09 à 13:01, Daniel.Li a écrit : Dear List, I'm using rsync to sync my data, see below command. And I met this error? I think it might be due to 2.6.9 and 3.0.5 compatible issue. So how to solve the problem? Thanks. rsync -vrtopg --progress --delete --password-file=rsync-password /path/on/pc r...@192.168.0.202::destination building file list ... 151804 files to consider rsync: push_dir#1 / (in maps) failed: Permission denied (13) rsync error: errors selecting input/output files, dirs (code 3) at main.c(486) [receiver=2.6.9] rsync: connection unexpectedly closed (4 bytes received so far) [sender] rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.5] -- Daniel -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- USI/SH RD Dept. Universal Scientific Industrial (Shanghai) Co., Ltd Fax: +86-21-58967931Tel: +86-21-58966996 ext. 1400 42th building, 1387 Zhang Dong road, Pudong New Area, Shanghai, P.R. China 201203 -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
