Re: [OMPI devel] problem with system() call and openib - blocks send/recv

2007-08-06 Thread Jeff Squyres
On Aug 6, 2007, at 8:08 AM, Bill Wichser wrote: Now I have another issue, which we fixed, with ROMIO/PVFS2/and openmpi 1.2.3. It seems that ROMIO support is way behind in openmpi and what we did was basically copy the stuff from mpich2, apply the pvfs2 romio patch and our problems went away.

Re: [OMPI devel] problem with system() call and openib - blocks send/recv

2007-08-06 Thread Bill Wichser
Thanks Jeff! I looked and didn't find anything but sure enough, there it is! Now I have another issue, which we fixed, with ROMIO/PVFS2/and openmpi 1.2.3. It seems that ROMIO support is way behind in openmpi and what we did was basically copy the stuff from mpich2, apply the pvfs2 romio pat

Re: [OMPI devel] problem with system() call and openib - blocks send/recv

2007-08-06 Thread Gleb Natapov
On Mon, Aug 06, 2007 at 09:53:20AM -0400, Bill Wichser wrote: > We have run across an issue, probably more related to openib than to > openmpi but don't know how to resolve. > > Linux kernel - 2.6.9-55.0.2.ELsmp x86_64 fork (and thus system()) is not supported by openib in this kernel. To get sys

Re: [OMPI devel] problem with system() call and openib - blocks send/recv

2007-08-06 Thread Jeff Squyres
Bill -- Check out http://www.open-mpi.org/faq/?category=openfabrics#ofa-fork. To my knowledge, RHEL4 has not yet received a hotfix that will allow fork() with OpenFabrics verbs applications when memory is still registered in the parent. On Aug 6, 2007, at 7:53 AM, Bill Wichser wrote: We

[OMPI devel] problem with system() call and openib - blocks send/recv

2007-08-06 Thread Bill Wichser
We have run across an issue, probably more related to openib than to openmpi but don't know how to resolve. Linux kernel - 2.6.9-55.0.2.ELsmp x86_64 libibverbs-1.0.4-7 openmpi - it doesn't matter - 1.1.5 and 1.2.3 both fail. When the sample code is run across IB nodes, using the IB interface,