Re: [lustre-discuss] ko2iblnd optimizations for EDR

2018-11-08 Thread Riccardo Veraldi
thanks for sharing your experience. I am running peer credits value 63 as it was for mlx4. I did not notice problems with these settings anyway to saturate the EDR bandwith writing and reading using Lustre I have to do it from 2 different clients, so that I can reach up to 9GB/s per OSS.

Re: [lustre-discuss] ko2iblnd optimizations for EDR

2018-11-08 Thread Martin Hecht
On 11/7/18 9:44 PM, Riccardo Veraldi wrote: > Anyway I Was wondering if something different is needed for mlx5 and > what are the suggested values in that case ? > > Anyone has experience with mlx5 LNET performance tunings ? Hi Riccardo, We have recently integrated mlx5 nodes into our fabric,

[lustre-discuss] ko2iblnd optimizations for EDR

2018-11-07 Thread Riccardo Veraldi
Hello, I found that regarding FDR Infiniband if I set ko2iblnd parameters as below I have quite an increase in performance using mlx4 options ko2iblnd timeout=100 peer_credits=63 credits=2560 concurrent_sends=63  fmr_pool_size=1280 fmr_flush_trigger=1024 ntx=5120 this suggested values