Re: [OMPI devel] Unwanted ibv_fork_init() mess(ages) and complaint for non-IB login node

2015-03-04 Thread Dave Goodell (dgoodell)
On Mar 4, 2015, at 3:25 PM, Paul Hargrove wrote: > On Wed, Mar 4, 2015 at 1:04 PM, Dave Goodell (dgoodell) > wrote: > [...] > > libibverbs: Warning: couldn't open config directory '/etc/libibverbs.d'. > > libibverbs: Warning: no userspace device-specific driver found for > > /sys/class/infinib

[OMPI devel] libfabric code does not build with pgi-{10,11}

2015-03-04 Thread Paul Hargrove
I don't know if anybody *cares*, but I find that the common:libfabric code compiles with pgi-{9,12,13,14} but not with pgi-{10,11}. These are versions 10.9 and 11.9 of pgi that built Open MPI 1.8.4 just fine. If somebody does care, let me know who and I'll send logs off-list. However, this can be

Re: [OMPI devel] Unwanted ibv_fork_init() mess(ages) and complaint for non-IB login node

2015-03-04 Thread Paul Hargrove
On Wed, Mar 4, 2015 at 1:04 PM, Dave Goodell (dgoodell) wrote: [...] > > libibverbs: Warning: couldn't open config directory '/etc/libibverbs.d'. > > libibverbs: Warning: no userspace device-specific driver found for > /sys/class/infiniband_verbs/uverbs0 > > I think that warning is printed by lib

Re: [OMPI devel] Unwanted ibv_fork_init() mess(ages) and complaint for non-IB login node

2015-03-04 Thread Dave Goodell (dgoodell)
On Mar 4, 2015, at 11:56 AM, Paul Hargrove wrote: > I have a system with InifniPath HCAs, where I've historically tested mtl:psm. > For some reason, that appears to have ceased working some time in the past 4 > months. > However, this report is about something else. > I am using the current mast

Re: [OMPI devel] master tarball broken

2015-03-04 Thread Paul Hargrove
The problem reported below is still present in openmpi-dev-1203-g171d674 -Paul On Wed, Mar 4, 2015 at 4:47 AM, Jeff Squyres (jsquyres) wrote: > I think Mike just recently committed the fix. I'll go kick off a master > tarball creation manually. > > > > On Mar 3, 2015, at 10:17 PM, Paul Hargrov

Re: [OMPI devel] Unwanted ibv_fork_init() mess(ages) and complaint for non-IB login node

2015-03-04 Thread Paul Hargrove
Since disabling oob:ud eliminated all of the messages, I am assuming that the warnings are from orted, which by its nature is expecting to fork()+exec() the application process. So, I would not be surprised if there is no setting to disable verbs fork support in oob:ud. However, since the node ex

Re: [OMPI devel] Unwanted ibv_fork_init() mess(ages) and complaint for non-IB login node

2015-03-04 Thread Jeff Squyres (jsquyres)
I wonder if this is why we invented the "-1" default value for enabling verbs fork support() -- because there are legitimate cases where ibv_fork_init() fails, and the user doesn't care. Hence, -1 allows it to fail and no one cares. Can you tell us why ibv_fork_init() would fail? > On Mar 4,

[OMPI devel] Unwanted ibv_fork_init() mess(ages) and complaint for non-IB login node

2015-03-04 Thread Paul Hargrove
I have a system with InifniPath HCAs, where I've historically tested mtl:psm. For some reason, that appears to have ceased working some time in the past 4 months. However, this report is about something else. I am using the current master tarball: openmpi-dev-1203-g171d674.tar.bz2 When I ran confi

Re: [OMPI devel] master tarball broken

2015-03-04 Thread Jeff Squyres (jsquyres)
I think Mike just recently committed the fix. I'll go kick off a master tarball creation manually. > On Mar 3, 2015, at 10:17 PM, Paul Hargrove wrote: > > I assume I am not the only one seeing the following with > openmpi-dev-1184-gbb22d26.tar.bz2 > > make[2]: *** No rule to make target >

[OMPI devel] master tarball broken

2015-03-04 Thread Paul Hargrove
I assume I am not the only one seeing the following with openmpi-dev-1184-gbb22d26.tar.bz2 make[2]: *** No rule to make target `/scratch/scratchdirs/hargrove/OMPI/openmpi-master-linux-x86_64-icc-12.1/BLD/opal/mca/common/verbs/ libmca_common_verbs.la', needed by `mca_oob_ud.la'. Stop. make[2]: Lea