On Jun 4, 2013, at 2:54 AM, Haggai Eran <hagg...@mellanox.com> wrote:

> We wish to get there eventually. In our current implementation you still
> have to register an on-demand memory region explicitly. The difference
> between a regular memory region is that the pages in the region aren't
> pinned.

Does this mean that an MPI implementation still has to register memory upon 
usage, and maintain its own registered memory cache?

> We chose to support only 2 concurrent page faults per QP since this
> allows us to maintain order between the QP's operations and the
> user-space code using it.


I talked to someone who was at the OpenFabrics workshop and saw the ODP 
presentation in person; he tells me that a fault will be incurred when a page 
is not in the HCA's TLB cache (vs. when a registered page is not in memory and 
must be swapped back in), and that this will trigger an RNR NAK.

Is this correct?

He was very concerned about what the size of the TLB on the HCA, and therefore 
what the actual run-time behavior would be for sending around large messages 
via MPI -- i.e., would RDMA'ing 1GB messages now incur this 
HCA-must-reload-its-TLB-and-therefore-incur-RNR-NAKs behavior?

-- 
Jeff Squyres
jsquy...@cisco.com
For corporate legal information go to: 
http://www.cisco.com/web/about/doing_business/legal/cri/

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Reply via email to