On 2 April 2012 06:49, Doug Ledford <dledf...@redhat.com> wrote:
> I'm fine with this change.  If people agree, I'll "make it so" in our 
> products.
>
> Sent from my ASUS Eee Pad
>
> Ira Weiny <wei...@llnl.gov> wrote:
>
> First, a question: what package installs the openibd script in OFED?  For the
> life of me I can't find this script in 1.5.4.1 or 3.2 ...  :-/  [*]
>
> Right now the "standard" for node description is, AFAIK, "<hostname> 
> HCA-<num>",
> where num is simply a counter for the HCA's as they are found in
> /sys/class/infiniband.
>
> The problem is resolving this "random" HCA number to an actual HCA on the
> host.  I thought about including the node description in ibstat but that seems
> a bit short sighted.  I think the better solution would be to append the hca
> name (ie mlx4_X, qibX, etc) to the hostname for the Node Description.
>
> Hacking the RHEL start up script is really easy to do this and results in nice
> names on the fabric which are easily resolved by the infiniband-diags,
> ibverbs, and perftest utilities.
>
> bash-4.1# ibhosts
> Ca      : 0x0002c90300325280 ports 1 "ending mlx4_2"
> Ca      : 0x001175000079da38 ports 1 "happy qib0"
> Ca      : 0x0002c90300108f2e ports 1 "ending mlx4_1"
> Ca      : 0x001175000077d90e ports 2 "ending qib0"
> Ca      : 0x0002c903004bebda ports 2 "happy mlx4_0"
> bash-4.1# hostname
> happy
> bash-4.1# ibstat mlx4_0
> CA 'mlx4_0'
>        CA type: MT26428
>        Number of ports: 2
>        Firmware version: 2.8.600
> ...
> bash-4.1# ibv_rc_pingpong -d mlx4_0
>  local address:  LID 0x0008, QPN 0x16004a, PSN 0x2e8316
> ...
> bash-4.1# rdma_bw -d mlx4_0
> 6089: | port=18515 | ib_port=1 | size=65536 | tx_depth=100 | sl=0 | 
> iters=1000 | duplex=0 | cma=0 |
> ...
>
> I realize this is really a distro thing but it would be nice if we could agree
> to change the current "standard".
>
> I can send a patch for RHEL and OFED (if I someone can point me to the openibd
> script or srpm).
>
> Thoughts?
> Ira
>
>
> [*] Last I knew openibd does the same as RHEL's rdma start up script in this 
> regard.
>
> --
> Ira Weiny
> Member of Technical Staff
> Lawrence Livermore National Lab
> 925-423-8008
> wei...@llnl.gov
> --
> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
> the body of a message to majord...@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

I have been doing something similar for a while.

Joseph.

-- 
Founder | Director | VP Research
Orion Virtualisation Solutions | www.orionvm.com.au | Phone: 1300 56
99 52 | Mobile: 0428 754 846
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Reply via email to