Les Mikesell wrote at about 11:48:36 -0500 on Sunday, March 13, 2011: > On 3/11/11 11:27 AM, Cesar Kawar wrote: > > > > I know that is "only" to process 800,000 files, but with version 3.0.0 and > > later, it doesn't load all the files at once. With a 512 Mb computer > > you'll be fine, but in the particular installation I was talking before, 1 > > Tb of data comprised of 1 year of historical data (that means a really big > > number of hardlink per file), the syncing process takes almost 100% CPU on > > an Intel Xeon Quad Core for about 2 hours. > > > > Are you sure this was a single run that included the directory above the > pool/cpool and pc directories (so it sees all the hardlink targets at once) > and > had the -H option? >
That's what I keep asking -- elsewhere Cesar mentions 2 *billion* files. So backing up 2 *billion* files comprising 1TB data on a machine with just 4GB memory in 2 hours just seems like orders of magnitude faster than what everybody else has experienced. And I don't see how even a Quad Xeon can explain that difference. ------------------------------------------------------------------------------ Colocation vs. Managed Hosting A question and answer guide to determining the best fit for your organization - today and in the future. http://p.sf.net/sfu/internap-sfd2d _______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/