On Thu, 2009-07-16 at 10:51 -0700, Jeff Haferman wrote:
> We have a SGE array task that we wish to run with elements 1-70000.  
> Each task generates output and takes roughly 20 seconds to 4 minutes  
> of CPU time.  We're doing them on a machine with about 144 8-core nodes,
> and we've divvied the job up to do about 500 at a time.
> 
> So, we have 500 jobs at a time writing to the same ZFS partition.

Sorry no answers, just some question that first came to mind.

Where is your bottleneck?  Is it drive I/O or Network?

Are all nodes accessing/writing via NFS?  Is this a NFS sync issue?
Might a SSD ZIL help?
-- 
Louis-Frédéric Feuillette <jeb...@gmail.com>

_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Reply via email to