The major factor affects the performance the the number of files in "PER"
directory.
If I got impression correct, there are 5M files in JUST one directory. If this
is true, then it is the problem.
The best way to avoid performance penalty is to sort different files into
differet named directori
At 11:46 AM 10/10/2009, Ckcheng wrote:
Hi all,
Currently, I have a directory with over 5M small files (1~32K). Now,
I want to transfer this directory to another machine and found
that it's extremely slow and painful process. I tried the following
method:
It might help if you mount all -onoatime
Ckcheng writes:
1. rsync
2. tar ..
If this is a migration I find that tar to the local machine, copy over,
restore, then rsync are likely the best options.
In my experience copying lots of small files is going to take a long time,
no matter which method you use.
From all the combinations
