Re: [lustre-discuss] o2ib on RoCE

2023-06-16 Thread Simon Guilbault
We are not using RoCE in production, but a few years ago we tested it with 25Gb/s cards. From what I recall, RDMA was working as expected using the MOFED stack, running lnet bench was using a few cores with TCP, while the same benchmark with RoCE was using almost 0 CPU cores. The only change I

[lustre-discuss] o2ib on RoCE

2023-06-16 Thread Lana Deere via lustre-discuss
We have been using Lustre on InfiniBand with o2ib(ib0) specified. If we had an Ethernet with RoCE enabled, would this work on that kind of network? If not, is there a different way to configure for RoCE which is recommended (using RDMA - I know we could switch to tcp)? .. Lana