Jacob Just got a report about the error below PetscDevice code is still experimental and I believe it should not be active (in any way) in the next release. It can also conflict with the current way we initialize devices. Can we comment out these two extra lines in PetscInitialize in main and 3.16? It seems it is currently the only point of entry to this new stuff.
[129]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [129]PETSC ERROR: GPU error [129]PETSC ERROR: cuda error 100 (cudaErrorNoDevice) : no CUDA-capable device is detected [129]PETSC ERROR: See https://petsc.org/release/faq/ <https://petsc.org/release/faq/> for trouble shooting. [129]PETSC ERROR: Petsc Development GIT revision: v3.15.3-732-ge2a280ad64 GIT Date: 2021-08-30 16:02:52 -0400 [129]PETSC ERROR: ../viscousDriver3d.Linux.64.mpiCC.mpifort.OPT.MPI.PETSC.ex on a named a13n04 by Unknown Thu Sep 2 18:38:04 2021 [129]PETSC ERROR: Configure options --COPTFLAGS="-O0 -mcpu=power9" --CUDAOPTFLAGS="-O0 -Xcompiler -mcpu=power9" --CXXOPTFLAGS="-O0 -mcpu=power9" --FOPTFLAGS="-O0 -mcpu=power9" --download-hypre-commit=origin/hypre_petsc --download-hypre=1 --download-metis --downl\ oad-parmetis --with-cuda-gencodearch=70 --with-cuda=1 --with-cxx-dialect=C++14 --with-debugging=1 --with-fortran-bindings=0 --prefix=/gpfs/alpine/world-shared/geo127/petsc/arch-dbg-gcc9.1.0-cuda11.0.3 PETSC_ARCH=arch-summit-hypre-cuda-dbg2 PETSC_DIR=/gpfs/alpine\ /csc314/scratch/adams/petsc2 [129]PETSC ERROR: #1 __initialize() at /gpfs/alpine/csc314/scratch/adams/petsc2/src/sys/objects/device/impls/cupm/cupmdevice.cxx:40 [129]PETSC ERROR: #2 getDevice() at /gpfs/alpine/csc314/scratch/adams/petsc2/src/sys/objects/device/impls/cupm/cupmdevice.cxx:59 [129]PETSC ERROR: #3 PetscDeviceCreate() at /gpfs/alpine/csc314/scratch/adams/petsc2/src/sys/objects/device/interface/device.cxx:49 [129]PETSC ERROR: #4 InitializeDeviceHelper_Private() at /gpfs/alpine/csc314/scratch/adams/petsc2/src/sys/objects/device/interface/device.cxx:143 [129]PETSC ERROR: #5 PetscDeviceInitializeDefaultDevices_Internal() at /gpfs/alpine/csc314/scratch/adams/petsc2/src/sys/objects/device/interface/device.cxx:179 [129]PETSC ERROR: #6 PetscInitialize() at /gpfs/alpine/csc314/scratch/adams/petsc2/src/sys/objects/pinit.c:1178 [129]PETSC ERROR: #7 main() at viscousDriver.cpp:241
