Hi all, I am trying to launch MPI jobs (with version openmpi-1.6.5) on a node with multiple InfiniBand HCA cards (pls. see ibstat info below). I just want to use the only active port: mlx4_0 port 2. Thus I issued
mpirun *-mca btl_openib_if_include "mlx4_0:2"* -np... I thought this command would allow only to use mlx4_0:2. But I still got below warning: ib_dev.c:241 MXM WARN No suitable active ports were found on IB device 'mlx4_1'. I wonder whether this support still works. Or are there any other supports to enable HCA card selection? And how can I change my default settings for MPI use? Thanks! Best, Na Zhang $ ibstat CA 'mlx4_0' CA type: MT4099 Number of ports: 2 Firmware version: 2.31.5050 Hardware version: 1 Node GUID: 0x0002c90300fee510 System image GUID: 0x0002c90300fee513 Port 1: State: Down Physical state: Disabled Rate: 10 Base lid: 0 LMC: 0 SM lid: 0 Capability mask: 0x00010000 Port GUID: 0x0202c9fffefee510 Link layer: Ethernet Port 2: State: Active Physical state: LinkUp Rate: 56 Base lid: 3 LMC: 0 SM lid: 8 Capability mask: 0x02514868 Port GUID: 0x0002c90300fee512 Link layer: InfiniBand CA 'mlx4_1' CA type: MT4099 Number of ports: 2 Firmware version: 2.30.3200 Hardware version: 1 Node GUID: 0x24be05ffffb584f0 System image GUID: 0x24be05ffffb584f3 Port 1: State: Down Physical state: Disabled Rate: 10 Base lid: 0 LMC: 0 SM lid: 0 Capability mask: 0x00010000 Port GUID: 0x26be05fffeb584f1 Link layer: Ethernet Port 2: State: Down Physical state: Disabled Rate: 10 Base lid: 0 LMC: 0 SM lid: 0 Capability mask: 0x00010000 Port GUID: 0x24be050001b584f2 Link layer: Ethernet
