Right, latency is the problem here. Every stat() is a tiny read
operation but it is one that has to come back over the network in the
case of iSCSI. I also think that was a pretty big slowdown but I don't
have much iSCSI experience and I have only used it on gigabit ethernet.
On 03/23/2018
>The difference is not crazy. But the find itself takes so much time !
38m for a find across 2,8m files looks a little bit slow, i'm getting 14k lines/s when doing "find . | pv -l -a >/dev/null" in my btrfs volume located via iscsi on a synology storage (3,5" ordinary sata disks) - while
Ok, so i did some tests.
find /path -type f -ls > /dev/null
First on my local SSD disk (1.9 millions files) :
1 find :
real2m16.743s
user0m7.607s
sys 0m45.952s
10 concurrent finds (approx same results for each) :
real4m48.629s
user0m11.013s
sys 2m0.288s
Almost double
