[EMAIL PROTECTED] wrote on Fri, 22 Dec 2006 15:45 -0600:
> We stumbled across some hardware issues/limitations with our IB
> hardware, and have 'devised' a way of working around these
> limitations by increasing the sizes of memory region allocations
> inside BMI, currently we're seeing chunks or blocks of 64KB being
> allocated on the hardware level (this is what the firmware people
> show us is allocated physically)
> Is there a way we can tune these allocation calls to the IB drivers,
> it should increase our ability to make large pinning requests if we
> can use larger than 64KB, they suggest 2MB.
>
> Are you aware of any specific memory region sizes that are allocated
> in the BMI-IB layers?
Take a look at
http://www.beowulf-underground.org/pipermail/pvfs2-developers/2006-October/002785.html
and the surrounding thread.
The patch that's discussed in there did get checked in, so recent
CVS HEAD will pin the entire buffer once if you try to send the
whole thing, rather than pinning multiple 64kB chunks of the buffer.
-- Pete
_______________________________________________
Pvfs2-developers mailing list
Pvfs2-developers@beowulf-underground.org
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
