Thanks for the suggestion Ole - I tried this out yesterday with RHEL 9.4 with
two slightly different setups.
1) Using the stock ice driver that comes with RHEL 9.4 for the card still saw
the issue.
2) There was not a pre-built version of the ice driver on the intel download
site, so I
Thanks for the suggestion Ole - I'll see if I can get that in the mix to try
over the next few days.
I can report that 23.02.7 tree had the same issues, so going backwards on the
slurm bits did not have any impact.
Brent
--
slurm-users mailing list -- slurm-users@lists.schedmd.com
To
ood way to tickle
the real issue. Over the next few days, I'll try to roll everything back to
RHEL 8.9 and see how that goes.
Brent
From: Henderson, Brent via slurm-users [mailto:slurm-users@lists.schedmd.com]
Sent: Thursday, May 2, 2024 11:32 AM
To: slurm-users@lists.schedmd.com
Subject: [sl
.
Thanks,
Brent
From: Henderson, Brent via slurm-users [mailto:slurm-users@lists.schedmd.com]
Sent: Wednesday, May 1, 2024 11:21 AM
To: slurm-users@lists.schedmd.com
Subject: [slurm-users] srun launched mpi job occasionally core dumps
Greetings Slurm gurus --
I've been having an issue where very
Greetings Slurm gurus --
I've been having an issue where very occasionally an srun launched OpenMPI job
launched will die during startup within MPI_Init(). E.g. srun -N 8
--ntasks-per-node=1 ./hello_world_mpi. Same binary launched with mpirun does
not experience the issue. E.g. mpirun -n 64
