On Oct 19, 2006, at 1:12 PM, Sam Lang wrote:
So the 256K chunks you see are from that default flow buffer size.
We only post bmi operations in flow buffer sized chunks, so at the
BMI method layer (IB in this case) on the server, you see those
memory registrations. On the client the buffer passed in through
the system interfaces is used, so I would bet that the memory
registrations don't get chunked into flow buffer sized regions like
they do on the server.
To change the flow buffer size, you can add this to your fs.conf:
FlowBufferSizeBytes 1446864
It needs to be added within the <Filesystem> context.
-sam
This will make a difference on MX as well. If you want to get the
most performance from a 10 Gb/s link, you want bulk transfers of 512
KB or (preferably) more.
Scott
_______________________________________________
Pvfs2-developers mailing list
Pvfs2-developers@beowulf-underground.org
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers