Hi all, does anyone have experience compiling PETSc with gnu openmpi and cross
compiling with cuda nvcc on these systems?
we have access to Vista, a machine in TACC and was trying to build PETSc with
these libraries. I would need gnu openmpi to compile my code (fortran std
2018), and would like to keep the same cpu compiler/openmpi for PETSc.I have
the following modules loaded:
Currently Loaded Modules:
1) ucc/1.3.0 2) ucx/1.17.0 3) cmake/3.29.5 4) xalt/3.1 5) TACC 6)
gcc/14.2.0 7) cuda/12.5 (g) 8) openmpi/5.0.5
Where:
g: built for GPU
Here mpicc points to the gcc compiler, etc. When configuring PETSc in the
following form I get nvcc not working:
$ ./configure COPTFLAGS="-O2 -g" CXXOPTFLAGS="-O2 -g" FOPTFLAGS="-O2 -g"
FCOPTFLAGS="-O2 -g" CUDAOPTFLAGS="-O2 -g" --with-debugging=1 --with-cc=mpicc
--with-cxx=mpicxx --with-fc=mpifort --with-cuda --with-cudac=nvcc
--with-cuda-arch=90 --download-fblaslapack=1 --with-make-np=8
=============================================================================================
Configuring PETSc to compile on your system
=============================================================================================
TESTING: checkCUDACompiler from
config.setCompilers(config/BuildSystem/config/setCompilers.py:1541)
*********************************************************************************************
UNABLE to CONFIGURE with GIVEN OPTIONS (see configure.log for
details):
---------------------------------------------------------------------------------------------
CUDA compiler you provided with -with-cudac=nvcc cannot be found or does not
work.
Cannot compile CUDA with nvcc.
*********************************************************************************************
I have nvcc in my path:
$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Thu_Jun__6_02:26:10_PDT_2024
Cuda compilation tools, release 12.5, V12.5.82
Build cuda_12.5.r12.5/compiler.34385749_0
I remember being able to do this cross compilation in polaris. Any help is most
appreciated,
Marcos
