Re: performance problem of using parallel rsync to stage data from 1 source to multiple destination

2005-09-02 Thread Paul Slootman
On Thu 01 Sep 2005, Xuehai Zhang wrote: If (similar) tasks are run in parallel, then the data of the files being handled may still be in the buffer cache so that it doesn't need to get read in from disk again. This will save time... I agree with you that caching effect might be the

Re: Status of rsync on win32

2005-09-02 Thread Misha Bergal
Wayne Davison [EMAIL PROTECTED] writes: On Sun, Aug 28, 2005 at 10:15:55AM -0500, Misha Bergal wrote: rsync on the server machine makes System process to consume about 90% of CPU time. If you are sending over a fast network, using -W (--whole-file) will save you CPU (and disk I/O). In

Re: performance problem of using parallel rsync to stage data from 1 source to multiple destination

2005-09-02 Thread Wayne Davison
Since it sounds like disk I/O is your limiting factor, you may wish to look into updating multiple systems using a batch file. This requires all the receiving systems to have identical files in the destination hierarchy. You would first create a batch file by performing the synchronization