Template Version: @(#)sac_nextcase 1.68 02/23/09 SMI This information is Copyright 2009 Sun Microsystems 1. Introduction 1.1. Project/Component Working Name: New IPonIB dladm properties 1.2. Name of Document Author/Supplier: Author: Venkatakrishnan Rajagopalan 1.3 Date of This Document: 17 June, 2009 4. Technical Description
A. Problem IP-on-IB (PSARC/2001/289 and PSARC/2007/636) is implemented as the ibd(7D) driver in Solaris. When customers face problems in bringing up ibd(7d) instances on Solaris, they are advised to take a number of steps to gather information about the IPoIB link that results in usability issues. Users currently need to run cfgadm to obtain the port GUID information, search the system messages file to determine if the IPoIB broadcast group is present or not, do 'ls -l' on the /dev/ibd* nodes to determine the IB partition that an ibd instance belongs to. There are also instances when it is necessary to obtain the P_Key corresponding to the ibd instance and HCA that it is bound do. These operations require a combination of commands, parsing device names, message files and GIDs to obtain the answer. B. Solution We propose to add the following read-only Infiniband-specific properties to dladm that could be displayed via 'dladm show-ib'. These properties are well known to each ibd driver instance and it would be a simple matter for the driver to provide them to users via 'dladm show-ib'. After discussing things with the dladm team, we are advocating a media specific subcommand (show-ib) because these read-only items are very specific to InfiniBand mapping of IPonIB. Note that while broadcast is possibly on or off, the status cannot be changed from the host (only from the IB Subnet Manager). A sample 'dladm show-ib' output for an ibd instance would be like below: LINK PROPERTY VALUE POSSIBLE ibd0 partition ffff -- ibd0 broadcast on on,off ibd0 guid 2c9030001c86c -- These properties will apply only to data links of type DL_IB. The dladm manpage changes are submitted in the materials directory. A micro/patch binding is asserted for this proposal. C. Interface Changes +----------------------------------------------------------------------------+ | Interface Classification Comments | +----------------------------------------------------------------------------+ | MAC_PROP_IB_PARTITION Consolidation Private P_Key value | | MAC_PROP_IB_BROADCAST Consolidation Private IPoIB broadcast group status | | MAC_PROP_IB_GUID Consolidation Private Port GUID | | "partition" Committed dladm property name | | "broadcast" Committed dladm property name | | "guid" Committed dladm property name | +----------------------------------------------------------------------------+ 6. Resources and Schedule 6.4. Steering Committee requested information 6.4.1. Consolidation C-team Name: ON 6.5. ARC review type: FastTrack 6.6. ARC Exposure: open