What I should have said was: NVIDIA -- can someone check to see if this is a PGI compiler error?
> On Apr 29, 2017, at 7:37 AM, Jeff Squyres (jsquyres) <jsquy...@cisco.com> > wrote: > > IBM: can someone check to see if this is a compiler error? > > >> On Apr 28, 2017, at 5:09 PM, Prentice Bisbal <pbis...@pppl.gov> wrote: >> >> Update: removing the -fast switch caused this error to go away. >> >> Prentice >> >> On 04/27/2017 06:00 PM, Prentice Bisbal wrote: >>> I'm building Open MPI 2.1.0 with PGI 17.3, and now I'm getting 'illegal >>> instruction' errors during 'make check': >>> >>> ../../config/test-driver: line 107: 65169 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_math >>> - 1 threads: Passed >>> >>> That's just one example of the error output. See all relevant error output >>> below. >>> >>> Usually, I see these errors when trying to run an executable on a processor >>> that doesn't support the instruction set of the executable. I used to see >>> this all the time when I supported an IBM Blue Gene/P system. I don't think >>> I've ever seen it on an x86 system. >>> >>> I'm passing the argument '-tp=x64' to pgcc to build a unified binary, so >>> that might be part of the problem, but I've used this exact same process to >>> build 2.1.0 with PGI 16.5 just a couple hours ago. I also built 1.10.3 with >>> the same compiler flags with PGI 16.5 and 17.3 without this error. >>> >>> Any ideas? >>> >>> The relevant output from 'make check': >>> >>> make check-TESTS >>> make[3]: Entering directory `/local/pbisbal/openmpi-2.1.0/test/asm' >>> make[4]: Entering directory `/local/pbisbal/openmpi-2.1.0/test/asm' >>> basename: extra operand `--test-name' >>> Try `basename --help' for more information. >>> --> Testing >>> PASS: atomic_barrier >>> - 1 threads: Passed >>> PASS: atomic_barrier >>> - 2 threads: Passed >>> PASS: atomic_barrier >>> - 4 threads: Passed >>> PASS: atomic_barrier >>> - 5 threads: Passed >>> PASS: atomic_barrier >>> - 8 threads: Passed >>> basename: extra operand `--test-name' >>> Try `basename --help' for more information. >>> --> Testing >>> PASS: atomic_barrier_noinline >>> - 1 threads: Passed >>> PASS: atomic_barrier_noinline >>> - 2 threads: Passed >>> PASS: atomic_barrier_noinline >>> - 4 threads: Passed >>> PASS: atomic_barrier_noinline >>> - 5 threads: Passed >>> PASS: atomic_barrier_noinline >>> - 8 threads: Passed >>> basename: extra operand `--test-name' >>> Try `basename --help' for more information. >>> --> Testing >>> PASS: atomic_spinlock >>> - 1 threads: Passed >>> PASS: atomic_spinlock >>> - 2 threads: Passed >>> PASS: atomic_spinlock >>> - 4 threads: Passed >>> PASS: atomic_spinlock >>> - 5 threads: Passed >>> PASS: atomic_spinlock >>> - 8 threads: Passed >>> basename: extra operand `--test-name' >>> Try `basename --help' for more information. >>> --> Testing >>> PASS: atomic_spinlock_noinline >>> - 1 threads: Passed >>> PASS: atomic_spinlock_noinline >>> - 2 threads: Passed >>> PASS: atomic_spinlock_noinline >>> - 4 threads: Passed >>> PASS: atomic_spinlock_noinline >>> - 5 threads: Passed >>> PASS: atomic_spinlock_noinline >>> - 8 threads: Passed >>> basename: extra operand `--test-name' >>> Try `basename --help' for more information. >>> --> Testing >>> ../../config/test-driver: line 107: 65169 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_math >>> - 1 threads: Passed >>> ../../config/test-driver: line 107: 65172 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_math >>> - 2 threads: Passed >>> ../../config/test-driver: line 107: 65176 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_math >>> - 4 threads: Passed >>> ../../config/test-driver: line 107: 65180 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_math >>> - 5 threads: Passed >>> ../../config/test-driver: line 107: 65185 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_math >>> - 8 threads: Passed >>> basename: extra operand `--test-name' >>> Try `basename --help' for more information. >>> --> Testing >>> ../../config/test-driver: line 107: 65195 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_math_noinline >>> - 1 threads: Passed >>> ../../config/test-driver: line 107: 65198 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_math_noinline >>> - 2 threads: Passed >>> ../../config/test-driver: line 107: 65202 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_math_noinline >>> - 4 threads: Passed >>> ../../config/test-driver: line 107: 65206 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_math_noinline >>> - 5 threads: Passed >>> ../../config/test-driver: line 107: 65210 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_math_noinline >>> - 8 threads: Passed >>> basename: extra operand `--test-name' >>> Try `basename --help' for more information. >>> --> Testing >>> ../../config/test-driver: line 107: 65220 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_cmpset >>> - 1 threads: Passed >>> ../../config/test-driver: line 107: 65223 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_cmpset >>> - 2 threads: Passed >>> ../../config/test-driver: line 107: 65227 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_cmpset >>> - 4 threads: Passed >>> ../../config/test-driver: line 107: 65231 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_cmpset >>> - 5 threads: Passed >>> ../../config/test-driver: line 107: 65235 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_cmpset >>> - 8 threads: Passed >>> basename: extra operand `--test-name' >>> Try `basename --help' for more information. >>> --> Testing >>> ../../config/test-driver: line 107: 65245 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_cmpset_noinline >>> - 1 threads: Passed >>> ../../config/test-driver: line 107: 65248 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_cmpset_noinline >>> - 2 threads: Passed >>> ../../config/test-driver: line 107: 65252 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_cmpset_noinline >>> - 4 threads: Passed >>> ../../config/test-driver: line 107: 65256 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_cmpset_noinline >>> - 5 threads: Passed >>> ../../config/test-driver: line 107: 65260 Illegal instruction "$@" > >>> $log_file 2>&1 >>> FAIL: atomic_cmpset_noinline >>> - 8 threads: Passed >>> ============================================================================ >>> >>> Testsuite summary for Open MPI 2.1.0 >>> ============================================================================ >>> >>> # TOTAL: 8 >>> # PASS: 4 >>> # SKIP: 0 >>> # XFAIL: 0 >>> # FAIL: 4 >>> # XPASS: 0 >>> # ERROR: 0 >>> ============================================================================ >>> >>> See test/asm/test-suite.log >>> Please report to http://www.open-mpi.org/community/help/ >>> ============================================================================ >>> >>> make[4]: *** [test-suite.log] Error 1 >>> make[4]: Leaving directory `/local/pbisbal/openmpi-2.1.0/test/asm' >>> make[3]: *** [check-TESTS] Error 2 >>> make[3]: Leaving directory `/local/pbisbal/openmpi-2.1.0/test/asm' >>> make[2]: *** [check-am] Error 2 >>> make[2]: Leaving directory `/local/pbisbal/openmpi-2.1.0/test/asm' >>> make[1]: *** [check-recursive] Error 1 >>> make[1]: Leaving directory `/local/pbisbal/openmpi-2.1.0/test' >>> make: *** [check-recursive] Error 1 >>> >>> >>> The contents of test/asm/test-suite.log: >>> >>> $ cat test/asm/test-suite.log >>> ============================================= >>> Open MPI 2.1.0: test/asm/test-suite.log >>> ============================================= >>> >>> # TOTAL: 8 >>> # PASS: 4 >>> # SKIP: 0 >>> # XFAIL: 0 >>> # FAIL: 4 >>> # XPASS: 0 >>> # ERROR: 0 >>> >>> .. contents:: :depth: 2 >>> >>> FAIL: atomic_math >>> ================= >>> >>> FAIL atomic_math (exit status: 132) >>> >>> FAIL: atomic_math_noinline >>> ========================== >>> >>> FAIL atomic_math_noinline (exit status: 132) >>> >>> FAIL: atomic_cmpset >>> =================== >>> >>> FAIL atomic_cmpset (exit status: 132) >>> >>> FAIL: atomic_cmpset_noinline >>> ============================ >>> >>> FAIL atomic_cmpset_noinline (exit status: 132) >>> >>> >>> And my configure command: >>> >>> ./configure \ >>> --prefix=/usr/pppl/pgi/17.3-pkgs/openmpi-2.1.0 \ >>> --disable-silent-rules \ >>> --enable-mpi-fortran \ >>> --enable-mpi-cxx \ >>> --enable-shared \ >>> --enable-static \ >>> --enable-mpi-thread-multiple \ >>> --with-cuda=/usr/pppl/cuda/cudatoolkit/6.5.14 \ >>> --with-pmix \ >>> --with-verbs \ >>> --with-hwloc \ >>> --with-pmi=/usr/pppl/slurm/15.08.8 \ >>> --with-slurm \ >>> --with-psm \ >>> CPP=cpp \ >>> CC=pgcc \ >>> CFLAGS="-fpic -tp=x64 -fast" \ >>> CXX=pgc++ \ >>> CXXFLAGS="-fpic -tp=x64 -fast" \ >>> FC=pgfortran \ >>> FCFLAGS="-fpic -tp=x64 -fast" \ >>> 2>&1 | tee configure.log >>> >> >> _______________________________________________ >> users mailing list >> users@lists.open-mpi.org >> https://rfd.newmexicoconsortium.org/mailman/listinfo/users > > > -- > Jeff Squyres > jsquy...@cisco.com > > _______________________________________________ > users mailing list > users@lists.open-mpi.org > https://rfd.newmexicoconsortium.org/mailman/listinfo/users -- Jeff Squyres jsquy...@cisco.com _______________________________________________ users mailing list users@lists.open-mpi.org https://rfd.newmexicoconsortium.org/mailman/listinfo/users
