Hi Krishna, As far as I know ZeroMQ can only use IPoIB via normal IP sockets. Looks like the idea of an RDMA zeromq transport came up in 2011, but went nowhere?
http://lists.zeromq.org/pipermail/zeromq-dev/2011-December/014784.html Another interesting example of adding RDMA support to a project with pluggable transports is net/9p (transport for fs/v9fs) in the Linux kernel. It might be useful to look at that code and follow its history to understand the problem better. http://lwn.net/Articles/301896/ As I recall the orig code in 2008, though functional, didn't deliver a big performance win over TCP (for that stack) and introduced new failure modes, making it unattractive and frustrating for casual users. It languished for years in a semi-broken state until people at CEA/Bull began working on it again in 2012-13. I'm guessing the second order issues CEA/Bull dealt with would be instructive. Also their Mooshika RDMA abstraction, which I think allows for a wireshark tap and testing w/o Infiniband card could be interesting. https://github.com/martinetd/mooshika Jim On Mon, May 05, 2014 at 07:38:05PM +0200, Krishna Narasimhan wrote: > Hello, > I am a researcher at Frankfurt University and currently working on > contributing to folks who use ZeroMq at Gsi , Darmstadt. Can anyone guide > me on which part of the code links ZeroMq to IPoIB. Because it doesnt seem > to be linked at code level. Does ZeroMq call some wrapper which directs to > IPoIb or normal IP? > > Any help here would be appreciated. this is rather urgent. > > On the other hand, I am also looking to contribute to including MPI (direct > RDMA) access for ZeroMq based applications, so anyone with this knowledge > will also be helpful. But am not sure this belongs to this thread. > > Thanks a lot. > > Regards > Krishna > _______________________________________________ > zeromq-dev mailing list > [email protected] > http://lists.zeromq.org/mailman/listinfo/zeromq-dev _______________________________________________ zeromq-dev mailing list [email protected] http://lists.zeromq.org/mailman/listinfo/zeromq-dev
