Re: [easybuild] Failure in UCX-1.14.1-GCCcore-12.3.0.eb when installing foss-2023a.eb

2024-03-15 Thread Åke Sandgren
That's unlikely to help. You either need to do an OS upgrade (which hopefully brings in a newer OFED stack) or install the MOFED stack separately. The libibverbs packages are tightly coupled to the (M)OFED drivers installed on the system, i.e. either the ones from the OS distro or the ones from

Re: [easybuild] Failure in UCX-1.14.1-GCCcore-12.3.0.eb when installing foss-2023a.eb

2024-03-15 Thread Joaquim Jornet Somoza
OK... I will try to updatet libibverbs , isn't it ? I will let you know ! Thanks ! quim Missatge de Åke Sandgren del dia dv., 15 de març 2024 a les 13:49: > ConnectX-3 gets dropped in MOFED 5.1, but MOFED 4.9 LTS will still work > for those. > > > From

Re: [easybuild] Failure in UCX-1.14.1-GCCcore-12.3.0.eb when installing foss-2023a.eb

2024-03-15 Thread Åke Sandgren
ConnectX-3 gets dropped in MOFED 5.1, but MOFED 4.9 LTS will still work for those. From: easybuild-requ...@lists.ugent.be on behalf of Ole Holm Nielsen Sent: Friday, March 15, 2024 13:21 To: easybuild@lists.ugent.be Subject: Re: [easybuild] Failure in U

Re: [easybuild] Failure in UCX-1.14.1-GCCcore-12.3.0.eb when installing foss-2023a.eb

2024-03-15 Thread Ole Holm Nielsen
Hi Joaquim, I think that old ConnectX-3 are no longer supported with recent Linux kernels (can anyone confirm this?). You may have to use an ancient (insecure) OS version, or stop using the ConnectX-3 adapters altogether :-( /Ole On 3/15/24 12:45, Joaquim Jornet Somoza wrote: Dear Ake, In

Re: [easybuild] Failure in UCX-1.14.1-GCCcore-12.3.0.eb when installing foss-2023a.eb

2024-03-15 Thread Åke Sandgren
Well, RH7 is deprecated, and that's an OFED 3.3 stack. They (UCX devs) probably didn't even come close to developing on something that old. So IBV_ACCESS_ON_DEMAND doesn't exist in that old distro. I strongly suggest updating, either both OS and OFED stack or just upgrade to the latest MOFED st

Re: [easybuild] Failure in UCX-1.14.1-GCCcore-12.3.0.eb when installing foss-2023a.eb

2024-03-15 Thread Joaquim Jornet Somoza
Hi ! We are running on a RH7.2 (apology for the typo ..) This is what I get: [easybuild@nd48:~]$ rpm -qf /usr/include/infiniband/verbs.h libibverbs-devel-1.1.8mlnx1-OFED.3.3.0.0.9.33100.x86_64 [easybuild@nd48:~]$ grep IBV_ACCESS_ON_DEMAND /usr/include/infiniband/verbs.h [easybuild@nd48:~]

Re: [easybuild] Failure in UCX-1.14.1-GCCcore-12.3.0.eb when installing foss-2023a.eb

2024-03-15 Thread Joaquim Jornet Somoza
Dear Ake, Indeed we have Mellanox IB, [:~]$ lspci | grep -i mellanox 02:00.0 Network controller: *Mellanox* Technologies MT27500 Family [ConnectX-3] [:~]$ ibstatus Infiniband device 'mlx4_0' port 1 status: default gid: fe80::::7079:9003:0007:f538 base lid:

Re: [easybuild] Failure in UCX-1.14.1-GCCcore-12.3.0.eb when installing foss-2023a.eb

2024-03-15 Thread Bart Oldeman
Hi, On 7.9 it's defined here: $ rpm -qf /usr/include/infiniband/verbs.h rdma-core-devel-22.4-6.el7_9.x86_64 $ grep IBV_ACCESS_ON_DEMAND /usr/include/infiniband/verbs.h IBV_ACCESS_ON_DEMAND= (1<<6), if you have MOFED it would be somewhere else, not sure. Le jeu. 14 mars 2024,

Re: [easybuild] Failure in UCX-1.14.1-GCCcore-12.3.0.eb when installing foss-2023a.eb

2024-03-15 Thread Åke Sandgren
lspci | grep -i mellanox will show if you have any mellanox devices on the system, some of these could be used as normal ethernet devices though ibstatus will show if any of those are running in Infiniband mode If ibstatus doesn't exist then you probably don't have infiniband, or at least lack

Re: [easybuild] Failure in UCX-1.14.1-GCCcore-12.3.0.eb when installing foss-2023a.eb

2024-03-15 Thread Joaquim Jornet Somoza
Dear Ake, How can I check this? Thank you! El vie, 15 mar 2024, 7:58, Åke Sandgren escribió: > No there is no bug there. > > Which MOFED stack version are you using? > Or does your system lack Infiniband? > > > From: easybuild-requ...@lists.ugent.be >