Re: [OMPI users] Eager sending on InfiniBand

2016-05-17 Thread Xiaolong Cui
Thanks a lot! On Tue, May 17, 2016 at 11:49 AM, Nathan Hjelm wrote: > > I don't know of any documentation on the connection manager other than > what is in the code and in my head. I rewrote a lot of the code in 2.x > so you might want to try out the latest 2.x tarball from > https://www.open-m

Re: [OMPI users] Eager sending on InfiniBand

2016-05-17 Thread Nathan Hjelm
I don't know of any documentation on the connection manager other than what is in the code and in my head. I rewrote a lot of the code in 2.x so you might want to try out the latest 2.x tarball from https://www.open-mpi.org/software/ompi/v2.x/ I know the per-peer queue pair will prevent totally a

Re: [OMPI users] Eager sending on InfiniBand

2016-05-17 Thread Xiaolong Cui
I think it is the connection manager that blocks the first message. If I add a pair of send/recv at the very beginning, the problem is gone. But removing the per-peer queue pair does not help. Do you know any document that discusses the open mpi internals, especially related to this problem? On T

Re: [OMPI users] Eager sending on InfiniBand

2016-05-17 Thread Nathan Hjelm
If it is blocking on the first message then it might be blocked by the connection manager. Removing the per-peer queue pair might help in that case. -Nathan On Mon, May 16, 2016 at 10:11:29PM -0400, Xiaolong Cui wrote: >Hi Nathan, >Thanks for your answer. >The "credits" make sense f