Re: [OMPI devel] ompi_win_create hangs on a non uniform cluster

2015-11-24 Thread Nathan Hjelm
This happens because we do not currently have a way to detect connectivity without allocating ompi_proc_t's for every rank in the window. I added the osc_rdma_btls MCA variable to act as a short-circuit that avoids the costly connectivity lookup. By default the value is ugni,openib. You can set it

Re: [OMPI devel] ompi_win_create hangs on a non uniform cluster

2015-11-14 Thread Gilles Gouaillardet
Howard, there is no rdma osc component in v2.x, so I doubt the issue occurs here. I will double check this anyway on Monday Cheers, Gilles On Sunday, November 15, 2015, Howard wrote: > > Hi Gilles > > Could you check whether you also see this problem with v2.x? > > Thanks, > > Howard > > Von

Re: [OMPI devel] ompi_win_create hangs on a non uniform cluster

2015-11-14 Thread Howard
Hi Gilles Could you check whether you also see this problem with v2.x? Thanks, Howard Von meinem iPhone gesendet > Am 10.11.2015 um 19:57 schrieb Gilles Gouaillardet : > > Nathan, > > a simple MPI_Win_create test hangs on my non uniform cluster > (ibm/onesided/c_create) > > one node has a

[OMPI devel] ompi_win_create hangs on a non uniform cluster

2015-11-10 Thread Gilles Gouaillardet
Nathan, a simple MPI_Win_create test hangs on my non uniform cluster (ibm/onesided/c_create) one node has an IB card but not the other one. the node with the IB card select the rdma osc module, but the other node select the pt2pt module. and then it hangs because both ends do no try to initi