Re: man page

2016-08-14 Thread ray vantassle
Nobody reads the rsync man page and assumes that it is recommending a commercial product. And nobody is going to read an "enhanced" rsync man page and get incentivised to start an open-source software project. Everybody knows that a mention of "Word" or "Photoshop" in an example refers to a gener

rsync very slow with large include/exclude file list

2015-06-15 Thread ray vantassle
I have a sensor collector system (very low-powered slow ARM cpu), and another system which daily pulls the data files from it for processing. There are about 1000 new files each day. As part of the processing it decides that certain of the files are of no interest, and adds them to an exclude file

Re: rsync very slow with large include/exclude file list

2015-06-15 Thread ray vantassle
I investigated the rsync code and found the reason why. For every file in the source, it searches the entire filter-list looking to see if that filename is on the exclude/include list. Most aren't, so it compares (350K - 72K) * 72K names (the non-listed files) plus (72K * 72K/2) names (the ones th

Re: [Bug 3099] Please parallelize filesystem scan

2015-07-17 Thread ray vantassle
Ken, this just happens to be a special case where your configuration has a huge number of spindles. If you have multiple threads reading the same spindle you'll just be thrashing the heads back & forth. If there is one thread reading at the front of the disk and another thread reading at the end

Re: I would like to add features to rsync: tags and saving local modifications

2015-08-22 Thread ray vantassle
" Feature 1: tags" Sounds like this would be no less work for the user than just having include/exclude filter list(s). But right now rsync works poorly with large filter lists. That's something I have fixed, but just haven't submitted the patches yet. Also: is xattr supported on all OS's and fi