On Thu, 2010-10-28 at 09:48 -0600, Hal Rosenstock wrote: > On Thu, Oct 28, 2010 at 11:05 AM, Jim Schutt <jasc...@sandia.gov> wrote: > > > > On Thu, 2010-10-28 at 07:42 -0600, Albino A. Aveleda wrote: > >> Dear Jim, > >> > >> I have compiled and installed the opensm with torus-2qos. > >> There is comment below in config file. > >> --- > >> # We need to tell the routing engine what directions we > >> # want the torus coordinate directions to be, by specifing > >> # the endpoints (switch GUID + port) of a link in each > >> # direction. These links need to share a common switch, > >> # which we call the torus seed. > >> # Here we specify positive coordinate directions: > >> xp_link 0x200000 0x200019 # S_0_0_0 -> S_1_0_0 > >> yp_link 0x200000 0x200005 # S_0_0_0 -> S_0_1_0 > >> zp_link 0x200000 0x200001 # S_0_0_0 -> S_0_0_1 > >> --- > >> > >> How do I get xp, yp and zp_link address? > > > > You can bring up your fabric once with some other routing > > engine, say minhop, and run ibnetdiscover. > > > > > > This will tell you the node GUIDs for all your switches. > > A minor clarification to the above: you don't need to run OpenSM at > all to run ibnetdiscover to get the switch GUIDs.
D'oh!! Thanks, Hal. -- Jim > > -- Hal > > > Then you need to pick a switch to be the seed. If you > > know that, e.g. your fabric is wired such that port 1, > > say, connects to the switch in the direction you want to > > be +x, look in your ibnetdiscover output to find the > > node GUID for the switch connected to that port of your > > seed switch. > > > > For maximum resiliency, pick the switch that your > > opensm host connects to as the seed. > > > > -- Jim > > > >> > >> Best regards, > >> Albino > >> > >> ----- "Jim Schutt" <jasc...@sandia.gov> escreveu: > >> > >> > > >> > This posting http://www.spinics.net/lists/linux-rdma/msg02967.html > >> > has some example input for a 5x5x5 torus. > >> > > >> > You'll want to configure your torus (via opensm --torus_config > >> > <file>) > >> > so that the intra-NEM links are z-direction links. This will allow > >> > you to swap a QNEM and keep the fabric routable during the process. > >> > > >> > Please look over the torus-2QoS section in > >> > opensm/doc/current-routing.txt > >> > to see why this is so, and to help understand why the info > >> > in torus-2QoS.conf is required. > >> > > >> > > > > > > -- > > To unsubscribe from this list: send the line "unsubscribe linux-rdma" in > > the body of a message to majord...@vger.kernel.org > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > > -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
