Hi Howard,
thank you for your answer.
I changed with mpi-selector the compiler to gfortran and you have right
this code works...
but now I have another problem with pi calculation: can you look at the
syntactic correctness of the program?
It happens that it uses only the 200% of cpu on each node also if I
request 4 threads:
mpirun -n 2 -npernode 1 --mca mpi_cuda_support 0 -x
OMP_NUM_THREADS=4 ./pi_parallel_do.f.exe
This is the code:
$ cat pi_parallel_do.f
PROGRAM Compute_PI
IMPLICIT NONE
include "mpif.h"
integer numprocs, rank, ierr
INTEGER*8 N, i
DOUBLE PRECISION w, x, sum
DOUBLE PRECISION pi, mypi
double precision n_mpi, pi_mpi
call MPI_Init(ierr)
call MPI_Comm_size(MPI_COMM_WORLD, numprocs, ierr)
call MPI_Comm_rank(MPI_COMM_WORLD, rank, ierr)
N = 500000000 !! Number of intervals
w = 1.0d0/(1.d0*N) !! width of each interval
sum = 0.0d0
pi_mpi = 0.0
!$OMP PARALLEL PRIVATE(x, mypi)
mypi = 0.0d0
!$OMP DO
DO i = 0, N-1 !! Parallel Loop
x = w * (i + 0.5d0)
mypi = mypi + w*4.d0/(1.d0 + x * x)
END DO
!$OMP END DO
!$OMP CRITICAL
pi_mpi = pi_mpi + mypi
!$OMP END CRITICAL
!$OMP END PARALLEL
call mpi_reduce(pi_mpi, pi, 1, MPI_DOUBLE_PRECISION, MPI_SUM, 0,
MPI_COMM_WORLD, ierr)
PRINT *, "Pi = ", pi
call MPI_Finalize(ierr)
END PROGRAM
And this is the output of ompi_info:
$ ompi_info
Package: Open MPI root@newton-s Distribution
Open MPI: 1.8.4
Open MPI repo revision: v1.8.3-330-g0344f04
Open MPI release date: Dec 19, 2014
Open RTE: 1.8.4
Open RTE repo revision: v1.8.3-330-g0344f04
Open RTE release date: Dec 19, 2014
OPAL: 1.8.4
OPAL repo revision: v1.8.3-330-g0344f04
OPAL release date: Dec 19, 2014
MPI API: 3.0
Ident string: 1.8.4
Prefix: /data/apps/mpi/openmpi-1.8.4-gnu
Configured architecture: x86_64-unknown-linux-gnu
Configure host: newton-s
Configured by: root
Configured on: Mon Apr 13 18:29:51 CEST 2015
Configure host: newton-s
Built by: root
Built on: lun 13 apr 2015, 18.42.15, CEST
Built host: newton-s
C bindings: yes
C++ bindings: yes
Fort mpif.h: yes (all)
Fort use mpi: yes (limited: overloading)
Fort use mpi size: deprecated-ompi-info-value
Fort use mpi_f08: no
Fort mpi_f08 compliance: The mpi_f08 module was not built
Fort mpi_f08 subarrays: no
Java bindings: no
Wrapper compiler rpath: runpath
C compiler: gcc
C compiler absolute: /usr/bin/gcc
C compiler family name: GNU
C compiler version: 4.4.7
C++ compiler: g++
C++ compiler absolute: /usr/bin/g++
Fort compiler: gfortran
Fort compiler abs: /usr/bin/gfortran
Fort ignore TKR: no
Fort 08 assumed shape: no
Fort optional args: no
Fort INTERFACE: yes
Fort ISO_FORTRAN_ENV: no
Fort STORAGE_SIZE: no
Fort BIND(C) (all): no
Fort ISO_C_BINDING: yes
Fort SUBROUTINE BIND(C): no
Fort TYPE,BIND(C): no
Fort T,BIND(C,name="a"): no
Fort PRIVATE: no
Fort PROTECTED: no
Fort ABSTRACT: no
Fort ASYNCHRONOUS: no
Fort PROCEDURE: no
Fort C_FUNLOC: no
Fort f08 using wrappers: no
Fort MPI_SIZEOF: no
C profiling: yes
C++ profiling: yes
Fort mpif.h profiling: yes
Fort use mpi profiling: yes
Fort use mpi_f08 prof: no
C++ exceptions: no
Thread support: posix (MPI_THREAD_MULTIPLE: yes, OPAL support:
yes,
OMPI progress: no, ORTE progress: yes, Event
lib:
yes)
Sparse Groups: no
Internal debug support: no
MPI interface warnings: yes
MPI parameter check: runtime
Memory profiling support: no
Memory debugging support: no
libltdl support: yes
Heterogeneous support: no
mpirun default --prefix: yes
MPI I/O support: yes
MPI_WTIME support: gettimeofday
Symbol vis. support: yes
Host topology support: yes
MPI extensions:
FT Checkpoint support: no (checkpoint thread: no)
C/R Enabled Debugging: no
VampirTrace support: yes
MPI_MAX_PROCESSOR_NAME: 256
MPI_MAX_ERROR_STRING: 256
MPI_MAX_OBJECT_NAME: 64
MPI_MAX_INFO_KEY: 36
MPI_MAX_INFO_VAL: 256
MPI_MAX_PORT_NAME: 1024
MPI_MAX_DATAREP_STRING: 128
MCA backtrace: execinfo (MCA v2.0, API v2.0, Component
v1.8.4)
MCA compress: bzip (MCA v2.0, API v2.0, Component v1.8.4)
MCA compress: gzip (MCA v2.0, API v2.0, Component v1.8.4)
MCA crs: none (MCA v2.0, API v2.0, Component v1.8.4)
MCA db: hash (MCA v2.0, API v1.0, Component v1.8.4)
MCA db: print (MCA v2.0, API v1.0, Component v1.8.4)
MCA event: libevent2021 (MCA v2.0, API v2.0, Component
v1.8.4)
MCA hwloc: hwloc191 (MCA v2.0, API v2.0, Component
v1.8.4)
MCA if: posix_ipv4 (MCA v2.0, API v2.0, Component
v1.8.4)
MCA if: linux_ipv6 (MCA v2.0, API v2.0, Component
v1.8.4)
MCA installdirs: env (MCA v2.0, API v2.0, Component v1.8.4)
MCA installdirs: config (MCA v2.0, API v2.0, Component v1.8.4)
MCA memory: linux (MCA v2.0, API v2.0, Component v1.8.4)
MCA pstat: linux (MCA v2.0, API v2.0, Component v1.8.4)
MCA sec: basic (MCA v2.0, API v1.0, Component v1.8.4)
MCA shmem: mmap (MCA v2.0, API v2.0, Component v1.8.4)
MCA shmem: posix (MCA v2.0, API v2.0, Component v1.8.4)
MCA shmem: sysv (MCA v2.0, API v2.0, Component v1.8.4)
MCA timer: linux (MCA v2.0, API v2.0, Component v1.8.4)
MCA dfs: app (MCA v2.0, API v1.0, Component v1.8.4)
MCA dfs: orted (MCA v2.0, API v1.0, Component v1.8.4)
MCA dfs: test (MCA v2.0, API v1.0, Component v1.8.4)
MCA errmgr: default_app (MCA v2.0, API v3.0, Component
v1.8.4)
MCA errmgr: default_hnp (MCA v2.0, API v3.0, Component
v1.8.4)
MCA errmgr: default_orted (MCA v2.0, API v3.0, Component
v1.8.4)
MCA errmgr: default_tool (MCA v2.0, API v3.0, Component
v1.8.4)
MCA ess: env (MCA v2.0, API v3.0, Component v1.8.4)
MCA ess: hnp (MCA v2.0, API v3.0, Component v1.8.4)
MCA ess: singleton (MCA v2.0, API v3.0, Component
v1.8.4)
MCA ess: slurm (MCA v2.0, API v3.0, Component v1.8.4)
MCA ess: tm (MCA v2.0, API v3.0, Component v1.8.4)
MCA ess: tool (MCA v2.0, API v3.0, Component v1.8.4)
MCA filem: raw (MCA v2.0, API v2.0, Component v1.8.4)
MCA grpcomm: bad (MCA v2.0, API v2.0, Component v1.8.4)
MCA iof: hnp (MCA v2.0, API v2.0, Component v1.8.4)
MCA iof: mr_hnp (MCA v2.0, API v2.0, Component v1.8.4)
MCA iof: mr_orted (MCA v2.0, API v2.0, Component
v1.8.4)
MCA iof: orted (MCA v2.0, API v2.0, Component v1.8.4)
MCA iof: tool (MCA v2.0, API v2.0, Component v1.8.4)
MCA odls: default (MCA v2.0, API v2.0, Component v1.8.4)
MCA oob: tcp (MCA v2.0, API v2.0, Component v1.8.4)
MCA plm: isolated (MCA v2.0, API v2.0, Component
v1.8.4)
MCA plm: rsh (MCA v2.0, API v2.0, Component v1.8.4)
MCA plm: slurm (MCA v2.0, API v2.0, Component v1.8.4)
MCA plm: tm (MCA v2.0, API v2.0, Component v1.8.4)
MCA ras: loadleveler (MCA v2.0, API v2.0, Component
v1.8.4)
MCA ras: simulator (MCA v2.0, API v2.0, Component
v1.8.4)
MCA ras: slurm (MCA v2.0, API v2.0, Component v1.8.4)
MCA ras: tm (MCA v2.0, API v2.0, Component v1.8.4)
MCA rmaps: lama (MCA v2.0, API v2.0, Component v1.8.4)
MCA rmaps: mindist (MCA v2.0, API v2.0, Component v1.8.4)
MCA rmaps: ppr (MCA v2.0, API v2.0, Component v1.8.4)
MCA rmaps: rank_file (MCA v2.0, API v2.0, Component
v1.8.4)
MCA rmaps: resilient (MCA v2.0, API v2.0, Component
v1.8.4)
MCA rmaps: round_robin (MCA v2.0, API v2.0, Component
v1.8.4)
MCA rmaps: seq (MCA v2.0, API v2.0, Component v1.8.4)
MCA rmaps: staged (MCA v2.0, API v2.0, Component v1.8.4)
MCA rml: oob (MCA v2.0, API v2.0, Component v1.8.4)
MCA routed: binomial (MCA v2.0, API v2.0, Component
v1.8.4)
MCA routed: debruijn (MCA v2.0, API v2.0, Component
v1.8.4)
MCA routed: direct (MCA v2.0, API v2.0, Component v1.8.4)
MCA routed: radix (MCA v2.0, API v2.0, Component v1.8.4)
MCA state: app (MCA v2.0, API v1.0, Component v1.8.4)
MCA state: hnp (MCA v2.0, API v1.0, Component v1.8.4)
MCA state: novm (MCA v2.0, API v1.0, Component v1.8.4)
MCA state: orted (MCA v2.0, API v1.0, Component v1.8.4)
MCA state: staged_hnp (MCA v2.0, API v1.0, Component
v1.8.4)
MCA state: staged_orted (MCA v2.0, API v1.0, Component
v1.8.4)
MCA state: tool (MCA v2.0, API v1.0, Component v1.8.4)
MCA allocator: basic (MCA v2.0, API v2.0, Component v1.8.4)
MCA allocator: bucket (MCA v2.0, API v2.0, Component v1.8.4)
MCA bcol: basesmuma (MCA v2.0, API v2.0, Component
v1.8.4)
MCA bcol: ptpcoll (MCA v2.0, API v2.0, Component v1.8.4)
MCA bml: r2 (MCA v2.0, API v2.0, Component v1.8.4)
MCA btl: openib (MCA v2.0, API v2.0, Component v1.8.4)
MCA btl: self (MCA v2.0, API v2.0, Component v1.8.4)
MCA btl: sm (MCA v2.0, API v2.0, Component v1.8.4)
MCA btl: smcuda (MCA v2.0, API v2.0, Component v1.8.4)
MCA btl: tcp (MCA v2.0, API v2.0, Component v1.8.4)
MCA btl: vader (MCA v2.0, API v2.0, Component v1.8.4)
MCA coll: basic (MCA v2.0, API v2.0, Component v1.8.4)
MCA coll: hierarch (MCA v2.0, API v2.0, Component
v1.8.4)
MCA coll: inter (MCA v2.0, API v2.0, Component v1.8.4)
MCA coll: libnbc (MCA v2.0, API v2.0, Component v1.8.4)
MCA coll: ml (MCA v2.0, API v2.0, Component v1.8.4)
MCA coll: self (MCA v2.0, API v2.0, Component v1.8.4)
MCA coll: sm (MCA v2.0, API v2.0, Component v1.8.4)
MCA coll: tuned (MCA v2.0, API v2.0, Component v1.8.4)
MCA dpm: orte (MCA v2.0, API v2.0, Component v1.8.4)
MCA fbtl: posix (MCA v2.0, API v2.0, Component v1.8.4)
MCA fcoll: dynamic (MCA v2.0, API v2.0, Component v1.8.4)
MCA fcoll: individual (MCA v2.0, API v2.0, Component
v1.8.4)
MCA fcoll: static (MCA v2.0, API v2.0, Component v1.8.4)
MCA fcoll: two_phase (MCA v2.0, API v2.0, Component
v1.8.4)
MCA fcoll: ylib (MCA v2.0, API v2.0, Component v1.8.4)
MCA fs: ufs (MCA v2.0, API v2.0, Component v1.8.4)
MCA io: ompio (MCA v2.0, API v2.0, Component v1.8.4)
MCA io: romio (MCA v2.0, API v2.0, Component v1.8.4)
MCA mpool: gpusm (MCA v2.0, API v2.0, Component v1.8.4)
MCA mpool: grdma (MCA v2.0, API v2.0, Component v1.8.4)
MCA mpool: rgpusm (MCA v2.0, API v2.0, Component v1.8.4)
MCA mpool: sm (MCA v2.0, API v2.0, Component v1.8.4)
MCA mtl: psm (MCA v2.0, API v2.0, Component v1.8.4)
MCA osc: rdma (MCA v2.0, API v3.0, Component v1.8.4)
MCA osc: sm (MCA v2.0, API v3.0, Component v1.8.4)
MCA pml: v (MCA v2.0, API v2.0, Component v1.8.4)
MCA pml: bfo (MCA v2.0, API v2.0, Component v1.8.4)
MCA pml: cm (MCA v2.0, API v2.0, Component v1.8.4)
MCA pml: ob1 (MCA v2.0, API v2.0, Component v1.8.4)
MCA pubsub: orte (MCA v2.0, API v2.0, Component v1.8.4)
MCA rcache: vma (MCA v2.0, API v2.0, Component v1.8.4)
MCA rte: orte (MCA v2.0, API v2.0, Component v1.8.4)
MCA sbgp: basesmsocket (MCA v2.0, API v2.0, Component
v1.8.4)
MCA sbgp: basesmuma (MCA v2.0, API v2.0, Component
v1.8.4)
MCA sbgp: p2p (MCA v2.0, API v2.0, Component v1.8.4)
MCA sharedfp: individual (MCA v2.0, API v2.0, Component
v1.8.4)
MCA sharedfp: lockedfile (MCA v2.0, API v2.0, Component
v1.8.4)
MCA sharedfp: sm (MCA v2.0, API v2.0, Component v1.8.4)
MCA topo: basic (MCA v2.0, API v2.1, Component v1.8.4)
MCA vprotocol: pessimist (MCA v2.0, API v2.0, Component
v1.8.4)
Il giorno gio, 25/06/2015 alle 11.00 -0600, Howard Pritchard ha scritto:
> Hello Fedele,
>
>
> Would it be possible to build the open mpi package to use gfortran
> and run the test again?
>
>
> Do you observe this problem if you build a Open MP (<-> MP not MPI)
> only version of the test case?
>
>
> I can't reproduce this problem using gfortran. I don't have access to
> an
> Intel compiler at the moment.
>
>
> Also, please send the output of ompi_info.
>
>
> Thanks,
>
>
> Howard
>
>
>
> 2015-06-25 10:37 GMT-06:00 Fedele Stabile
> <fedele.stab...@fis.unical.it>:
> Hello to all,
> I'm trying hybrid OpenMP + MPI programming, when I run the
> simple code
> listed below I have an error:
> forrtl: severe (40): recursive I/O operation, unit -1, file
> unknown
> Image PC Routine Line
> Source
> aa 0000000000403D8E Unknown
> Unknown
> Unknown
> aa 0000000000403680 Unknown
> Unknown
> Unknown
> libiomp5.so 00002B705F7C5BB3 Unknown
> Unknown
> Unknown
> libiomp5.so 00002B705F79A617 Unknown
> Unknown
> Unknown
> libiomp5.so 00002B705F799D3A Unknown
> Unknown
> Unknown
> libiomp5.so 00002B705F7C5EAD Unknown
> Unknown
> Unknown
> libpthread.so.0 00002B705FA699D1 Unknown
> Unknown
> Unknown
> libc.so.6 00002B705FD688FD Unknown
> Unknown
> Unknown
> -------------------------------------------------------
> Primary job terminated normally, but 1 process returned
> a non-zero exit code.. Per user-direction, the job has been
> aborted.
> -------------------------------------------------------
>
> --------------------------------------------------------------------------
> mpirun detected that one or more processes exited with
> non-zero status,
> thus causing
> the job to be terminated. The first process to do so was:
>
> Process name: [[61634,1],0]
> Exit code: 40
>
> I have compiled OpenMPI using this configuration options:
> ./configure --prefix=/data/apps/mpi/openmpi-1.8.4-intel
> -enable-mpirun-prefix-by-default --enable-mpi-fortran
> --enable-mpi-thread-multiple
> --with-tm=/usr/local/torque-5.1.0-1_4048f77c/src --with-verbs
> --with-openib --with-cuda=/usr/local/cuda-6.5
>
> This is the listing of the simple code:
> program hello
> include "mpif.h"
>
> integer numprocs, rank, namelen, ierr
> character*(MPI_MAX_PROCESSOR_NAME) processor_name
> integer iam, np
> integer omp_get_num_threads, omp_get_thread_num
>
> call MPI_Init(ierr)
> call MPI_Comm_size(MPI_COMM_WORLD, numprocs, ierr)
> call MPI_Comm_rank(MPI_COMM_WORLD, rank, ierr)
> call MPI_Get_processor_name(processor_name, namelen,
> ierr)
> iam = 0
> np = 1
> !$omp parallel default(shared) private(iam, np)
>
> np = omp_get_num_threads()
> iam = omp_get_thread_num();
> write(*,*)"Hello from thread ", iam," out of
> ", np,
> % " from process ", rank," out of ", numprocs,
> % " on ", processor_name
>
> !$omp end parallel
> call MPI_Finalize(ierr)
> stop
> end
>
> Can you help me to solve the problem?
> Thank you,
> Fedele Stabile
>
>
> _______________________________________________
> users mailing list
> us...@open-mpi.org
> Subscription:
> http://www.open-mpi.org/mailman/listinfo.cgi/users
> Link to this post:
> http://www.open-mpi.org/community/lists/users/2015/06/27192.php
>
>
