Hello Brice,

Thank you for your reply ...

Am 30.08.2020 um 14:24 schrieb Brice Goglin:
...
Do you know which lstopo is correct here?

yes - version 2.x

Do you have a way to know if
the IB interface is indeed connected to first NUMA node of 2nd package,
or to 2nd NUMA node of 1st package?

bcn2226:~ $ opahfirev
######################
bcn2226  - HFI 0000:54:00.0
HFI:   hfi1_0
Board: ChipABI 3.0, ChipRev 7.17, SW Compat 3
SN:    0x013b8b3b
Location:Discrete  Socket:0 PCISlot:00 NUMANode:1  HFI0
Bus:
GUID:  0011:7509:013b:8b3b
SiRev: B1 (11)
######################

=> 2nd NUMA node of 1st package

Benchmarking IB bandwidth when
memory/cores are in NUMA node #1 vs #2 would be nice.

I did that, and it clearly confirms that this PCIslot indeed sits at the 2nd NUMA node of the 1st package. See the attached plot.

... and the 1.11.13 fixup should be disabled in this case.

OK, I will change line 234 in "pci-common.c" from

    if (cpumodel && strstr(cpumodel, "Xeon")) {

to something like

if (cpumodel && strstr(cpumodel, "Xeon") && (strstr(cpumodel, "v3") || strstr(cpumodel, "v4"))) {

to restrict the fixup to Xeon Haswell (v3) and Xeon Broadwell (v4). This was the intention you had in mind, correct?


Best wishes,
Christian

--
Dr. Christian Tuma
Consultant, Supercomputing
Zuse Institute Berlin, Takustr. 7, 14195 Berlin, Germany
+49 30 84185132 | t...@zib.de | www.zib.de
_______________________________________________
hwloc-users mailing list
hwloc-users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/hwloc-users

Reply via email to