On Jul 31, 2006, at 7:30 PM, Rich Teer wrote:

On Mon, 31 Jul 2006, Dale Ghent wrote:

So what does this exercise leave me thinking? Is Linux 2.4.x really screwed up in NFS-land? This Solaris NFS replaces a Linux-based NFS server that the

Linux has had, uhhmmm (struggling to be nice), iffy NFS for ages.

Right, but I never had this speed problem when the NFS server was running Linux on hardware that had the quarter of the CPU power and half the disk i/o capacity that the new Solaris-based one has.

So either Linux's NFS client was more compatible with the bugs in Linux's NFS server and ran peachy that way, or something's truly messed up with how Solaris's NFS server handles Linux NFS clients.

Mind you, all the tests I did in my previous posts were on shares served out of ZFS. I just lopped a fresh LUN off another Xserve RAID on my SAN, gave it to the NFS server and put UFS on it. Let's see if there's a difference when mounting that on the clients:

Linux NFS client mounting UFS-backed share:
=====================
[EMAIL PROTECTED]/$ mount -o nfsvers=3,rsize=32768,wsize=32768 ds2- private:/ufsfoo /mnt
[EMAIL PROTECTED]/$ cd /mnt
[EMAIL PROTECTED]/mnt$ time dd if=/dev/zero of=blah bs=1024k count=128128 +0 records in
128+0 records out

real    0m9.267s
user    0m0.000s
sys     0m2.480s
=====================

Hey! look at that! 9.2 seconds in this test. The same test with the ZFS-backed share (see previous email in this thread) took 1m 21s to complete. Remember this same test that I did but with a NFSv2 mount and took 36 minutes to complete on the ZFS-backed share? Let's try that here with the UFS-based share:

=====================
[EMAIL PROTECTED]/$mount -o nfsvers=2,rsize=32768,wsize=32768 ds2-private:/ ufsfoo /mnt
[EMAIL PROTECTED]/$ cd /mnt
[EMAIL PROTECTED]/mnt$ time dd if=/dev/zero of=blah2 bs=1024k count=128128 +0 records in
128+0 records out

real    0m3.103s
user    0m0.000s
sys     0m2.880s
=====================

Three seconds vs. 36 minutes.

Me thinks that there's something fishy here, regardless of Linux's reputation in the NFS world.

Don't get me wrong. I love Solaris like I love taffy (and BOY do I love taffy) but there seems to be some really wonky Linux<->NFS<- >Solaris<->ZFS interaction going on that's really killing performance and my finger so far points at Solaris. :/

/dale
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Reply via email to