Get some iostat/vmstat numbers. # iostat -x /dev/sdX 1 # vmstat 1 How much memory do the nodes have? If more than 2G, XFS is probably leveraging its delayed allocation feature to heavily cache the writes. iostat/vmstat should show that.
Is the timing for the 10 node test cumulative? Laurence Mayer wrote: > Hi, > > I am currently running a 10 Node OCFS2 Cluster (version 1.3.9-0ubuntu1) > on Ubuntu Server 8.04 x86_64. > Linux n1 2.6.24-24-server #1 SMP Tue Jul 7 19:39:36 UTC 2009 x86_64 > GNU/Linux > > The Cluster is connected to a 1Tera iSCSI Device presented by an IBM > 3300 Storage System, running over a 1Gig Network. > Mounted on all nodes: /dev/sdc1 on /cfs1 type ocfs2 > (rw,_netdev,data=writeback,heartbeat=local) > Maximum Nodes: 32 > Block Size=4k > Cluster Size=4k > > My testing shows that to write simultaneously from the 10 nodes, 10 x > 200Meg files (1 file per node, total of 2Gig) takes ~23.54secs. > Reading the files back can take just as long. > > Do these numbers sound correct? > > Doing dd if=/dev/zero of=/cfs1/xxxxx/txt count=1000 bs=2048000 (2Gig) > from a single node takes 16secs. > > (running the same dd command on an XFS filesystem connected to the same > iSCSI Storage takes 2.2secs) > > Is there any tips & tricks to improve performance on OCFS2? > > Thanks in advance > Laurence > > _______________________________________________ > Ocfs2-users mailing list > [email protected] > http://oss.oracle.com/mailman/listinfo/ocfs2-users > _______________________________________________ Ocfs2-users mailing list [email protected] http://oss.oracle.com/mailman/listinfo/ocfs2-users
