It turns out that SuperMicro recently released a BIOS update for our motherboards. No release notes to say what all was done, but after installing the update we now have MaxReadReq = 4096. I ran ib_rdma_bw and now we are getting 1500MB/s instead of 1336.
On Jan 21, 2008 4:14 AM, Bart Van Assche <[EMAIL PROTECTED]> wrote: > On Jan 18, 2008 5:09 PM, Sagi Rotem <[EMAIL PROTECTED]> wrote: > > This may be your problem: > > MaxReadReq 128 bytes > > U need a BIOS update , common value with good performance is 512. > > Alternatively u can force it using setpci but than system may be > > unstable. > > After unloading and reloading the ib_mthca module with parameter > tune_pci=1 (which sets MaxReadReq to 4096,) ib_rdma_bw now reports a > bandwidth of 933 MB/s. > > Thanks, > > Bart. >
_______________________________________________ general mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
