On Mon, 14 Sep 2009 09:19:06 -0400 Hal Rosenstock <hal.rosenst...@gmail.com> wrote:
> On Mon, Sep 14, 2009 at 2:20 AM, Keshetti Mahesh > <keshetti.mah...@gmail.com>wrote: > > > I have a small question. If there are all 5 Gbps (maximum supported > > speed) ports > > except one with 10 Gbps in a subnet then what is the expected behavior > > of OpenSM > > while setting active link speed ? > > > It depends on the peer port and the link between them. > > > > Does OpenSM force the port with 10 > > Gbps to operate > > at 5 Gbps or not ? > > > > SM (including OpenSM) sets PortInfo enabled components based on peer ports' > supported components and link negotiation determines the active components. > > So in the case where one port supports 10 Gbps speed and it's peer port only > supports 5, the SM sets LinkSpeedEnabled components on the peer ports to 5 > Gbps (encoded as 3). In the case where the peer port supports 10 Gbps, it is > set to 10 Gbps (encoded as 5 or 7 depending on what is supported). The link > then negotiates to one of the enabled speeds and sets LinkSpeedActive > accoridingly. Hal is correct. Just to be clear, the examples below are running in a cluster which I "forced" to SDR using OpenSM's "force_link_speed" option. This just happened to be the easiest way for me to show you the output of a link which is running at sub-optimal speeds. Ira > > -- Hal > > > > > > > -- > > Keshetti Mahesh > > > > On Thu, Sep 10, 2009 at 9:32 PM, Ira Weiny <wei...@llnl.gov> wrote: > > > Also, iblinkinfo will report links which it finds capable of either > > faster or wider operation. iblinkinfo checks both ends of the link as Hal > > mentions. It reports this with output like. > > > > > > Switch 0x0005ad0000092106 Cisco Switch SFS7000D: > > > ... > > > 7 8[ ] ==( 4X 2.5 Gbps Active/ LinkUp)==> 8 12[ ] > > "MT47396 Infiniscale-III Mellanox Technologies" ( Could be 5.0 Gbps) > > > ... > > > > > > Also the portstatus console command in OpenSM will report links which are > > running at "reduced speed or width". Although this does not check the > > remote port. > > > > > > OpenSM $ help portstatus > > > portstatus [ca|switch|router] > > > summarize port status > > > [ca|switch|router] -- limit the results to the node type specified > > > OpenSM $ portstatus > > > "ALL" port status: > > > 115 port(s) scanned on 9 nodes in 26 us > > > 85 down > > > 30 active > > > 32 at 4X > > > 22 at 2.5 Gbps > > > 8 at 5.0 Gbps > > > 2 at 10.0 Gbps > > > > > > Possible issues: > > > 2 disabled > > > 0x0008f10400411b18 5 (ISR9024D Voltaire) > > > 0x0005ad0000092106 13 (Cisco Switch SFS7000D) > > > 6 with reduced speed > > > 0x0008f10500200220 33 (Voltaire 4036 - 36 QDR ports switch) > > > 0x0008f10500200220 19 (Voltaire 4036 - 36 QDR ports switch) > > > 0x0005ad0000092106 21 (Cisco Switch SFS7000D) > > > 0x0005ad0000092106 20 (Cisco Switch SFS7000D) > > > 0x0005ad0000092106 9 (Cisco Switch SFS7000D) > > > 0x0005ad0000092106 8 (Cisco Switch SFS7000D) > > > > > > > > > Ira > > > > > > On Thu, 10 Sep 2009 09:23:35 -0400 > > > Hal Rosenstock <hal.rosenst...@gmail.com> wrote: > > > > > >> On Thu, Sep 10, 2009 at 9:02 AM, Keshetti Mahesh > > >> <keshetti.mah...@gmail.com>wrote: > > >> > > >> > Added 'ibcheckspeed' and 'ibcheckportspeed': Similar to > > >> > 'ibcheckwidth/ibcheckportwidth' in functionality and implementation. > > >> > Reports error/warning messages if the LinkSpeedActive is configured as > > >> > 2.5 Gbps when the LinkSpeedSupported is more than 2.5 Gbps. > > >> > > > >> > > >> ibportstate checks for more than this in terms of speed (and width) > > >> anomalies. > > >> > > >> Would it be better for these scripts to use that tool now ? > > Alternatively, > > >> the additional speed/width anomaly checks could be implemented in these > > >> scripts but it does involve checking the peer port so there's a little > > more > > >> to it. > > >> > > >> -- Hal > > >> > > >> > > >> > > > >> > Signed-off-by: Keshetti Mahesh < keshetti.mah...@gmail.com> > > >> > --- > > >> > infiniband-diags/scripts/ibcheckportspeed.in | 146 > > >> > ++++++++++++++++++++++++++ > > >> > infiniband-diags/scripts/ibcheckportwidth.in | 2 +- > > >> > infiniband-diags/scripts/ibcheckspeed.in | 135 > > >> > ++++++++++++++++++++++++ > > >> > 3 files changed, 282 insertions(+), 1 deletions(-) > > >> > create mode 100644 infiniband-diags/scripts/ibcheckportspeed.in > > >> > create mode 100644 infiniband-diags/scripts/ibcheckspeed.in > > >> > > > >> <snip...> > > >> > > > > > > > > > -- > > > Ira Weiny > > > Math Programmer/Computer Scientist > > > Lawrence Livermore National Lab > > > 925-423-8008 > > > wei...@llnl.gov > > > > > > -- Ira Weiny Math Programmer/Computer Scientist Lawrence Livermore National Lab 925-423-8008 wei...@llnl.gov _______________________________________________ general mailing list general@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
