Hi Howard,
many thanks for your reply:
On 8 December 2016 at 17:22, Howard Pritchard <hpprit...@gmail.com> wrote:
> hello Daniele,
>
> Could you post the output from ompi_info command? I'm noticing on the
> RPMS that came with the rhel7.2 distro on
> one of our systems that it was built to support psm2/hfi-1.
>
>
please find attached the optput of ompi_info
> Two things, could you try running applications with
>
> mpirun --mca pml ob1 (all the rest of your args)
>
> and see if that works?
>
It works without complaining!
> Second, what sort of system are you using? Is this a cluster? If it is,
> you may want to check whether
> you have a situation where its an omnipath interconnect and you have the
> psm2/hfi1 packages installed
> but for some reason the omnipath HCAs themselves are not active.
>
> On one of our omnipath systems the following hfi1 related pms are
> installed:
>
> *hfi*diags-0.8-13.x86_64
>
> *hfi*1-psm-devel-0.7-244.x86_64
> lib*hfi*1verbs-0.5-16.el7.x86_64
> *hfi*1-psm-0.7-244.x86_64
> *hfi*1-firmware-0.9-36.noarch
> *hfi*1-psm-compat-0.7-244.x86_64
> lib*hfi*1verbs-devel-0.5-16.el7.x86_64
> *hfi*1-0.11.3.10.0_327.el7.x86_64-245.x86_64
> *hfi*1-firmware_debug-0.9-36.noarc
> *hfi*1-diagtools-sw-0.8-13.x86_64
>
>
> The machine is a dual processor with attached (GPUs and) Intel Xeon Phi.
The Mpss 3.7 is installed.
The Xeon Phi is a 3120A (Knights Corner), so should be without omni-path.
I have no hfi package installed but I have the
libpsm2.x86_64 10.2.33-1.el7
any idea?
cheers
daniele
> Howard
>
> 2016-12-08 8:45 GMT-07:00 r...@open-mpi.org <r...@open-mpi.org>:
>
>> Sounds like something didn’t quite get configured right, or maybe you
>> have a library installed that isn’t quite setup correctly, or...
>>
>> Regardless, we generally advise building from source to avoid such
>> problems. Is there some reason not to just do so?
>>
>> On Dec 8, 2016, at 6:16 AM, Daniele Tartarini <
>> d.tartar...@sheffield.ac.uk> wrote:
>>
>> Hi,
>>
>> I've installed on a Red Hat 7.2 the OpenMPI distributed via Yum:
>>
>> * openmpi-devel.x86_64 1.10.3-3.el7 *
>>
>> any code I try to run (including the mpitests-*) I get the following
>> message with slight variants:
>>
>> * my_machine.171619hfi_wait_for_device: The /dev/hfi1_0 device
>> failed to appear after 15.0 seconds: Connection timed out*
>>
>> Is anyone able to help me in identifying the source of the problem?
>> Anyway, * /dev/hfi1_0* doesn't exist.
>>
>> If I use an OpenMPI version compiled from source I have no issue (gcc
>> 4.8.5).
>>
>> many thanks in advance.
>>
>> cheers
>> Daniele
>> _______________________________________________
>> users mailing list
>> users@lists.open-mpi.org
>> https://rfd.newmexicoconsortium.org/mailman/listinfo/users
>>
>>
>>
>> _______________________________________________
>> users mailing list
>> users@lists.open-mpi.org
>> https://rfd.newmexicoconsortium.org/mailman/listinfo/users
>>
>
>
> _______________________________________________
> users mailing list
> users@lists.open-mpi.org
> https://rfd.newmexicoconsortium.org/mailman/listinfo/users
>
--
--
Daniele Tartarini
Post-Doctoral Research Associate
Dept. Mechanical Engineering &
INSIGNEO, institute for *in silico* medicine,
University of Sheffield, Sheffield, UK
linkedIn <http://uk.linkedin.com/in/danieletartarini>
$ ompi_info
Package: Open MPI mockbuild@ Distribution
Open MPI: 1.10.3
Open MPI repo revision: v1.10.2-251-g9acf492
Open MPI release date: Jun 14, 2016
Open RTE: 1.10.3
Open RTE repo revision: v1.10.2-251-g9acf492
Open RTE release date: Jun 14, 2016
OPAL: 1.10.3
OPAL repo revision: v1.10.2-251-g9acf492
OPAL release date: Jun 14, 2016
MPI API: 3.0.0
Ident string: 1.10.3
Prefix: /usr/lib64/openmpi
Configured architecture: x86_64-pc-linux-gnu
Configure host:
Configured by: mockbuild
Configured on: Fri Aug 5 07:44:11 EDT 2016
Configure host:
Built by: mockbuild
Built on: Fri Aug 5 07:48:35 EDT 2016
Built host:
C bindings: yes
C++ bindings: yes
Fort mpif.h: yes (all)
Fort use mpi: yes (limited: overloading)
Fort use mpi size: deprecated-ompi-info-value
Fort use mpi_f08: no
Fort mpi_f08 compliance: The mpi_f08 module was not built
Fort mpi_f08 subarrays: no
Java bindings: no
Wrapper compiler rpath: runpath
C compiler: gcc
C compiler absolute: /usr/bin/gcc
C compiler family name: GNU
C compiler version: 4.8.5
C++ compiler: g++
C++ compiler absolute: /usr/bin/g++
Fort compiler: gfortran
Fort compiler abs: /usr/bin/gfortran
Fort ignore TKR: no
Fort 08 assumed shape: no
Fort optional args: no
Fort INTERFACE: yes
Fort ISO_FORTRAN_ENV: yes
Fort STORAGE_SIZE: no
Fort BIND(C) (all): no
Fort ISO_C_BINDING: yes
Fort SUBROUTINE BIND(C): no
Fort TYPE,BIND(C): no
Fort T,BIND(C,name="a"): no
Fort PRIVATE: no
Fort PROTECTED: no
Fort ABSTRACT: no
Fort ASYNCHRONOUS: no
Fort PROCEDURE: no
Fort USE...ONLY: no
Fort C_FUNLOC: no
Fort f08 using wrappers: no
Fort MPI_SIZEOF: no
C profiling: yes
C++ profiling: yes
Fort mpif.h profiling: yes
Fort use mpi profiling: yes
Fort use mpi_f08 prof: no
C++ exceptions: no
Thread support: posix (MPI_THREAD_MULTIPLE: no, OPAL support: yes,
OMPI progress: no, ORTE progress: yes, Event lib:
yes)
Sparse Groups: no
Internal debug support: no
MPI interface warnings: yes
MPI parameter check: runtime
Memory profiling support: no
Memory debugging support: no
dl support: yes
Heterogeneous support: no
mpirun default --prefix: no
MPI I/O support: yes
MPI_WTIME support: native
Symbol vis. support: yes
Host topology support: yes
MPI extensions:
FT Checkpoint support: no (checkpoint thread: no)
C/R Enabled Debugging: no
VampirTrace support: yes
MPI_MAX_PROCESSOR_NAME: 256
MPI_MAX_ERROR_STRING: 256
MPI_MAX_OBJECT_NAME: 64
MPI_MAX_INFO_KEY: 36
MPI_MAX_INFO_VAL: 256
MPI_MAX_PORT_NAME: 1024
MPI_MAX_DATAREP_STRING: 128
MCA backtrace: execinfo (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA compress: bzip (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA compress: gzip (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA crs: none (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA db: hash (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA db: print (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA dl: dlopen (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA event: libevent2021 (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA hwloc: external (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA if: posix_ipv4 (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA if: linux_ipv6 (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA installdirs: env (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA installdirs: config (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA memchecker: valgrind (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA memory: linux (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA pstat: linux (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA sec: basic (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA shmem: mmap (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA shmem: posix (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA shmem: sysv (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA timer: linux (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA dfs: app (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA dfs: orted (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA dfs: test (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA errmgr: default_app (MCA v2.0.0, API v3.0.0, Component
v1.10.3)
MCA errmgr: default_hnp (MCA v2.0.0, API v3.0.0, Component
v1.10.3)
MCA errmgr: default_orted (MCA v2.0.0, API v3.0.0, Component
v1.10.3)
MCA errmgr: default_tool (MCA v2.0.0, API v3.0.0, Component
v1.10.3)
MCA ess: env (MCA v2.0.0, API v3.0.0, Component v1.10.3)
MCA ess: hnp (MCA v2.0.0, API v3.0.0, Component v1.10.3)
MCA ess: singleton (MCA v2.0.0, API v3.0.0, Component
v1.10.3)
MCA ess: slurm (MCA v2.0.0, API v3.0.0, Component v1.10.3)
MCA ess: tool (MCA v2.0.0, API v3.0.0, Component v1.10.3)
MCA filem: raw (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA grpcomm: bad (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA iof: mr_hnp (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA iof: hnp (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA iof: mr_orted (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA iof: orted (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA iof: tool (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA odls: default (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA oob: tcp (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA plm: isolated (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA plm: rsh (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA plm: slurm (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA ras: gridengine (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA ras: loadleveler (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA ras: simulator (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA ras: slurm (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA rmaps: mindist (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA rmaps: ppr (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA rmaps: rank_file (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA rmaps: resilient (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA rmaps: round_robin (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA rmaps: seq (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA rmaps: staged (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA rml: oob (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA routed: binomial (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA routed: debruijn (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA routed: direct (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA routed: radix (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA state: app (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA state: staged_hnp (MCA v2.0.0, API v1.0.0, Component
v1.10.3)
MCA state: dvm (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA state: hnp (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA state: novm (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA state: orted (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA state: staged_orted (MCA v2.0.0, API v1.0.0, Component
v1.10.3)
MCA state: tool (MCA v2.0.0, API v1.0.0, Component v1.10.3)
MCA allocator: basic (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA allocator: bucket (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA bcol: basesmuma (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA bcol: ptpcoll (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA bml: r2 (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA btl: openib (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA btl: self (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA btl: sm (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA btl: tcp (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA btl: usnic (MCA v2.0.0, API v1.10.3, Component v1.10.3)
MCA btl: vader (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA coll: basic (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA coll: hierarch (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA coll: inter (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA coll: libnbc (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA coll: ml (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA coll: self (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA coll: sm (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA coll: tuned (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA dpm: orte (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA fbtl: posix (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA fcoll: dynamic (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA fcoll: individual (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA fcoll: static (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA fcoll: two_phase (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA fcoll: ylib (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA fs: ufs (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA io: ompio (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA io: romio (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA mpool: grdma (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA mpool: sm (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA mtl: ofi (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA mtl: psm (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA mtl: psm2 (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA osc: pt2pt (MCA v2.0.0, API v3.0.0, Component v1.10.3)
MCA osc: sm (MCA v2.0.0, API v3.0.0, Component v1.10.3)
MCA pml: v (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA pml: bfo (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA pml: cm (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA pml: ob1 (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA pubsub: orte (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA rcache: vma (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA rte: orte (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA sbgp: basesmsocket (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA sbgp: basesmuma (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA sbgp: p2p (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA sharedfp: individual (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA sharedfp: lockedfile (MCA v2.0.0, API v2.0.0, Component
v1.10.3)
MCA sharedfp: sm (MCA v2.0.0, API v2.0.0, Component v1.10.3)
MCA topo: basic (MCA v2.0.0, API v2.1.0, Component v1.10.3)
MCA vprotocol: pessimist (MCA v2.0.0, API v2.0.0, Component
v1.10.3)_______________________________________________
users mailing list
users@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/users
