Re: [OMPI devel] coll/tuned MPI_Bcast can crash or silently fail when using distinct datatypes across tasks

2014-04-23 Thread Gilles Gouaillardet
Nathan, i uploaded this part to github : https://github.com/ggouaillardet/ompi-svn-mirror/tree/flatten-datatype you really need to check the last commit : https://github.com/ggouaillardet/ompi-svn-mirror/commit/a8d014c6f144fa5732bdd25f8b6b05b07ea8 please consider this as experimental and poo

Re: [OMPI devel] coll/tuned MPI_Bcast can crash or silently fail when using distinct datatypes across tasks

2014-04-23 Thread Gilles Gouaillardet
George, i am sorry i cannot see how flatten datatype can be helpful here :-( in this example, the master must broadcast a long vector. this datatype is contiguous so the flatten'ed datatype *is* the type provided by the MPI application. how would pipelining happen in this case (e.g. who has to c

Re: [OMPI devel] coll/tuned MPI_Bcast can crash or silently fail when using distinct datatypes across tasks

2014-04-23 Thread Nathan Hjelm
The ompi_datatype_flatten.c file appears to be missing. Let me know once it is committed and I will take a look. I will see if I can write the RMA code using it over the next week or so. -Nathan On Wed, Apr 23, 2014 at 02:43:12PM +0900, Gilles Gouaillardet wrote: > Nathan, > > i uploaded this pa

Re: [OMPI devel] coll/tuned MPI_Bcast can crash or silently fail when using distinct datatypes across tasks

2014-04-23 Thread Gilles Gouaillardet
my bad :-( this has just been fixed Gilles On 2014/04/23 14:55, Nathan Hjelm wrote: > The ompi_datatype_flatten.c file appears to be missing. Let me know once > it is committed and I will take a look. I will see if I can write the > RMA code using it over the next week or so. >

[OMPI devel] openmpi and XRC API from ofed-3.12

2014-04-23 Thread Piotr Lesnicki
Hi, In OFED-3.12 the API for XRC has changed. I did not find corresponding changes in Open MPI: for example the function 'ibv_create_xrc_rcv_qp()' queried in openmpi configure script no longer exists in ofed-3.12-rc1. Are there any plans to support the new XRC API ? -- Piotr

[OMPI devel] RFC: Remove heterogeneous support

2014-04-23 Thread Jeff Squyres (jsquyres)
WHAT: Remove data-heterogeneous support from Open MPI WHY: No one uses it (it's not the default), it's broken (probably has been for a while) WHERE: Datatype engine, some configury, and a few other places TIMEOUT: Tuesday teleconf, 6 May 2014 (i.e., 2 weeks from now) MORE DETAIL: It recently

Re: [OMPI devel] openmpi and XRC API from ofed-3.12

2014-04-23 Thread Nathan Hjelm
Yes, we plan to fix support for XRC due to the changes in 3.12. It will probably not happen before 1.8.2 though. -Nathan On Wed, Apr 23, 2014 at 02:58:49PM +0200, Piotr Lesnicki wrote: > Hi, > > In OFED-3.12 the API for XRC has changed. I did not find > corresponding changes in Open MPI: for exa

[OMPI devel] Bug report: non-blocking allreduce with user-defined operation gives segfault

2014-04-23 Thread Rupert Nash
Hello devel list I've been trying to use a non-blocking MPI_Iallreduce in a CFD application I'm working on, but it kept segfaulting on me. I have reduced it to a simple test case - see the gist here for the full code https://gist.github.com/rupertnash/1182 build and run with:

Re: [OMPI devel] openmpi and XRC API from ofed-3.12

2014-04-23 Thread Paul Hargrove
As maintainer of a different communications library over Verbs I'd like to ask: Where can one find information on the new APIs and their use? -Paul On Wed, Apr 23, 2014 at 7:01 AM, Nathan Hjelm wrote: > Yes, we plan to fix support for XRC due to the changes in 3.12. It will > probably not ha

Re: [OMPI devel] Bug report: non-blocking allreduce with user-defined operation gives segfault

2014-04-23 Thread George Bosilca
Rupert, You are right, the code of any non-blocking reduce is not built with user-level op in mind. However, I'm not sure about your patch. One reason is that ompi_3buff is doing target = source1 op source2 while ompi_2buf is doing target op= source (notice the op=) Thus you can't replace omp