Hello,
I seem to notice an issue when building modules using HierarchicalNamingScheme
when building out the intel and intelcuda toolchains.
I notice that MODULEPATH is set for icc and ifort for intel directory. This is
correct when setting up intel toolchain.
hpcswadm@hpcv18$grep -iR MODULEPATH
icc/2017.1.132-GCC-5.2.0.lua:prepend_path("MODULEPATH",
"/nfs/grid/software/testing/RHEL7/easybuild/modules/all/Compiler/intel/2017.1.132-GCC-5.2.0")
ifort/2017.1.132-GCC-5.2.0.lua:prepend_path("MODULEPATH",
"/nfs/grid/software/testing/RHEL7/easybuild/modules/all/Compiler/intel/2017.1.132-GCC-5.2.0")
impi gets installed in the path for intel as expected.
hpcswadm@hpcv18$ls -R
/nfs/grid/software/testing/RHEL7/easybuild/modules/all/Compiler/intel/2017.1.132-GCC-5.2.0/
/nfs/grid/software/testing/RHEL7/easybuild/modules/all/Compiler/intel/2017.1.132-GCC-5.2.0/:
impi
/nfs/grid/software/testing/RHEL7/easybuild/modules/all/Compiler/intel/2017.1.132-GCC-5.2.0/impi:
2017.1.132.lua
As for impi built with iccifortcuda it gets installed in
hpcswadm@hpcv18$ls -R
/nfs/grid/software/testing/RHEL7/easybuild/modules/all/Compiler/intel-CUDA/
/nfs/grid/software/testing/RHEL7/easybuild/modules/all/Compiler/intel-CUDA/:
2017.1.132-GCC-5.2.0-7.5.18
/nfs/grid/software/testing/RHEL7/easybuild/modules/all/Compiler/intel-CUDA/2017.1.132-GCC-5.2.0-7.5.18:
impi
/nfs/grid/software/testing/RHEL7/easybuild/modules/all/Compiler/intel-CUDA/2017.1.132-GCC-5.2.0-7.5.18/impi:
2017.1.132.lua
The problem is when loading iimpic toolchain it loads up icc and ifort modules
along with impi that belongs to the module tree from intel and not intel-CUDA.
I am not sure if this is a problem, but it seems like the impi is not being
picked up correctly.
hpcswadm@hpcv18$ml av iimpi
-------------------------------------
/nfs/grid/software/testing/RHEL7/easybuild/modules/all/Core
-------------------------------------
iimpi/2017.01-GCC-5.2.0 (TC) iimpic/2017.01-GCC-5.2.0 (TC)
hpcswadm@hpcv18$ml
Currently Loaded Modules:
1) EasyBuild/3.1.0
hpcswadm@hpcv18$ml iimpic
Currently Loaded Modules:
1) EasyBuild/3.1.0 3) icc/2017.1.132-GCC-5.2.0 (I) 5) impi/2017.1.132
(I) 7) iimpic/2017.01-GCC-5.2.0 (
TC)
2) GCC/5.2.0 4) ifort/2017.1.132-GCC-5.2.0 (I) 6) CUDA/7.5.18
hpcswadm@hpcv18$which mpicc
/nfs/grid/software/testing/RHEL7/easybuild/software/Compiler/intel/2017.1.132-GCC-5.2.0/impi/2017.1.132/bin64/mpicc
The one that should be loaded is from
/nfs/grid/software/testing/RHEL7/easybuild/software/Compiler/intel-CUDA/2017.1.132-GCC-5.2.0-7.5.18/impi/2017.1.132/bin64/mpicc
I think the impi module should not sit inside intel directory or somehow icc
and ifort MODULEPATH need to be changed to intel-CUDA when loading iimpic
/nfs/grid/software/testing/RHEL7/easybuild/modules/all/Compiler/intel/2017.1.132-GCC-5.2.0
----------------------
impi/2017.1.132 (I,L)
Anyone else come across this issue.
Shahzeb Siddiqui
HPC Linux Engineer
B2220-447.2
Groton, CT
