We are currently investigating infiniband and we are so far very
impressed with the ease of use of the OFED stack. However we seem to
have run into an issue with the srp disc discovery.
We wish to protect the storage from unwanted use. In a fibre channel
san environment this would be done in two ways, firstly presentation
( configuring the controller as to which luns each WWN can access )
and secondly zoning which is configuring the switches that make the
fabric as to which ports can communicate. If we can't do this it would
restrict IB to a single use eg as a replacement for fibre switches.
I can't see how to specify to either srp_daemon or ibsrpdm which pkey
to use when discovering discs and a quick look at the source code
doesn't inspire confidence as I can see pkey=ffff as a string in the
code.
I did try the following:
One host with one adapter communicating with DDN controller, with no
access control ( pkeys )
The correct lun information was discovered.
[EMAIL PROTECTED]:~# ibsrpdm -c
id_ext
=
50001ff3000501f0
,ioc_guid
=
50001ff3000501f0
,dgid
=fe8000000000000050001ff4000501f0,pkey=ffff,service_id=f0010500f31f0050
Access control was reasserted, and can be seen as the lun can no
longer be discovered.
[EMAIL PROTECTED]:~# ibsrpdm -c
The device was created by "hand" with the pkey set to the correct value
echo
"id_ext
=
50001ff3000501f0
,ioc_guid
=
50001ff3000501f0
,dgid
=
fe8000000000000050001ff4000501f0
,pkey=1001,service_id=f0010500f31f0050" > /sys/class/infiniband_srp/
srp-mthca0-1/add_target
And the device can be seen.
multipath -ll
360001ff001f0dbac01000800000a6a6cdm-0 DDN ,S2A 9900
[size=5.2T][features=0][hwhandler=0]
\_ round-robin 0 [prio=1][enabled]
\_ 5:0:0:1 sdb 8:16 [active][ready]
So the issue appears to be with ibsrpdm/srp_daemon not allowing the
pkey to be set
The following message suggests the same.
user_mad: process ibsrpdm did not enable P_Key index support.
user_mad: Documentation/infiniband/user_mad.txt has info on the new
ABI.
_______________________________________________
general mailing list
[email protected]
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
