Well ok i've made my own ebuild with openib-drivers , v 1.4 (in
attachment), i tried it and it compiles except ehca flag (won't compile
with it), if someone's interested, please check it and put into the overlay
i have another question, i have big PERFORMANCE problems with infiniband
on gentoo, no matter if i use kernel drivers or openib-drivers, here's
what OSU latency benchmark says:
first, OSU over Gigabit Ethernet (for comparison):
# OSU MPI Latency Test v3.1.1
# Size Latency (us)
0 76.37
1 77.77
2 77.66
4 77.92
8 77.95
16 77.98
Infiniband - drivers from openib-drivers ebuild
# OSU MPI Latency Test v3.1.1
# Size Latency (us)
0 50.23
1 52.10
2 51.99
4 51.62
8 51.79
16 52.17
Infiniband - drivers from kernel 2.6.27 - results are almost the same,
except everywhere, where there is 5x (fifty) , it's 4x (fourty)
Infiniband on CentOS (installed from RPM OFED)
# OSU MPI Latency Test v3.1.1
# Size Latency (us)
0 1.65
1 1.82
2 1.81
4 1.72
8 1.60
16 1.61
so, the last one is perfect, Infiniband over IP works as expected
in previous test my benchmarks suffered terrible performance loss over
infiniband on gentoo (the same with OSU Bandwidth benchmark, on Gentoo:
500-750MB/s , on CentOS: 1400 MB/s)
any suggestions? maybe some packages from this overlay are doing
something wrong?
--
Dept of Computational Biophysics & Bioinformatics,
Faculty of Biochemistry, Biophysics and Biotechnology,
Jagiellonian University,
ul. Gronostajowa 7,
30-387 Krakow, Poland.
Tel: (+48-12)-664-6380
