It sounds like you are describing rsync building the file list before transferring starts, which takes a long time, and there really isn't much you can do about that. One thing you might try is splitting your data up with multiple RsyncShareNames. I'm thinking that might help avoid ALRM, but shouldn't really decrease the overall time much.
You should install the sysstat package on both ends (sar, iostat, etc) and enable the sar cronjob to keep track of your stats. Then you can run `sar` and see if you were hitting I/O or cpu bottlenecks. brien Jason B wrote: > Hi all, > > First off, just wanted to say thank you to everyone who helped me with my > Aborted by signal ALRM problem when backing up huge dirs, especially Jason > and > Holger. Using the Exclude dirs parameter worked beautifully, and I just > re-ran > the full backup every day for about a week, gradually excluding less and less > and it finally completed and has been working well since. > > The question I have is this. I'm in the process of doing this for the second > server, which is 140GB in many thousands of files, and doing a full backup > actually takes quite a while just to generate all the hardlinks before it > even > gets to transferring data. What constrains the speed at which these hardlinks > are created - the backuppc server's CPU, the client's CPU (for rsync > checksums), the disk speed (running ext3 / raid5 on 5 drives), or what else > could it be? > > Thanks very much. > > -J > > > ------------------------------------------------------------------------- > Take Surveys. Earn Cash. Influence the Future of IT > Join SourceForge.net's Techsay panel and you'll get the chance to share your > opinions on IT & business topics through brief surveys-and earn cash > http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV > _______________________________________________ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/backuppc-users > http://backuppc.sourceforge.net/ > ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
