Re: [OMPI devel] use of stat() during malloc initialization

2013-01-10 Thread Jeff Squyres (jsquyres)
Committed in https://svn.open-mpi.org/trac/ompi/changeset/27785, and I filed CMRs to get this fix in 1.6.4 and 1.7. On Jan 10, 2013, at 9:23 AM, Phil Carns wrote: > Thanks Jeff. I tested the patch just now using Open MPI SVN trunk revision > 27784. I was able to instrument an application w

Re: [OMPI devel] use of stat() during malloc initialization

2013-01-10 Thread Phil Carns
Thanks Jeff. I tested the patch just now using Open MPI SVN trunk revision 27784. I was able to instrument an application without any trouble at all, and the patch looks great. I definitely understand the memory registration cache pain. I've dabbled in network abstractions for file systems

Re: [OMPI devel] use of stat() during malloc initialization

2013-01-09 Thread Jeff Squyres (jsquyres)
Greetings Phil. Good analysis. You can thank OFED for this horribleness, BTW. :-) Since OFED hardware requires memory registration, and since that registration is expensive, MPI implementations cache registered memory to alleviate the re-registration costs for repeated memory usage. But MPI

[OMPI devel] use of stat() during malloc initialization

2013-01-09 Thread Phil Carns
Hi, I am a developer on the Darshan project (http://www.mcs.anl.gov/darshan), which provides a set of lightweight wrappers to characterize the I/O access patterns of MPI applications. Darshan can operate on static or dynamic executables. As you might expect, it uses the LD_PRELOAD mechanism