Hi, Les Mikesell wrote on 23.12.2006 at 19:39:51 [Re: [BackupPC-users] Out of memory error]: > Yves Trudeau wrote: > > [...] I try to backup a rsync share with 200k files (20 GB) and I > > got a "Out of memory!" error. [...] > > Rsync sends the entire directory listing first with a certain amount > of per-file overhead before both sides walk through the list to > transfer differences. If you can break the run into smaller > subdirectories it should help - or use a different transfer > method.
true enough, but in this case the numbers do not seem to support this as the cause of the problem. 864MB RSS / 200k files = about 4 KB per file, which seems a bit much, does it not? A quick test with 150k files and native rsync shows a peak memory usage of about 16MB during file list transfer and 25MB later on (and that's virtual memory, RSS is even lower). I'd be surprised if File::RsyncP used *that* much more memory. Yves Trudeau wrote on 23.12.2006 at 20:05:32 [Re: [BackupPC-users] Out of memory error]: > [...] > and the process that uses a lot of RAM is BackupPC. Here is a line of "top" > > 5305 backuppc 16 0 1527m 864m 624 S 1.0 85.5 0:45.15 BackupPC_dump > > > The RSS is 864m and VM is 1527m. Quite large in my opinion. Here is > the output of df: > > [EMAIL PROTECTED]:backuppc /]df > Sys. de fich. Tail. Occ. Disp. %Occ. Monté sur > /dev/hdv1 90G 586M 90G 1% / Might this be related to your vserver setup? What are you using? What type of file system? Regards, Holger ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
