I have started investigating the memory usage of the rsync algorithm since installing OpenWRT on a Linksys WRT160NL router with only 32MB of RAM. I have read several discussions about rsync's use of memory.
Rsync consumes all of the memory on my router even when I ensure incremental scanning is used. This is not what I expect. The directory I am recursively synchronizing contains 56,545 directories in its tree. However, the maximum number of entries in any one directory is only 2,783. I have been looking into working around this by breaking up the synchronization task. Has anyone else come up with a good technique to do this? I have seen references to this idea, but no concrete code. What I am doing right now is: find . -type d -print -exec sh -c "rsync --dirs -vv -l -p -e ssh "\{\}"/* r...@host.example.com:/DEST-DIR/"\{\} \; This is a bit slow because I need to establish SSH connections and initialize rsync 56,545 times. I'd like to hear other people's solutions. Mike -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html