Hi Alex, On Wed, 2011-07-06 at 01:07 -0700, Alex Netes wrote: > Hi Al, > > On 10:46 Tue 05 Jul , Albert Chu wrote: > > Hi Alex, > > > > On Tue, 2011-07-05 at 10:07 -0700, Alex Netes wrote: > > > Hi Al, > > > > > > On 09:53 Tue 05 Jul , Albert Chu wrote: > > > > Hi Alex, > > > > > > > > Thanks. Are you still reviewing the remote_guid_sorting patch (the 2/4 > > > > patch)? Or do you feel there is work there that needs to be done? > > > > > > > > > > I thought we agreed that same goal could be achieved using > > > route_port_ordering_file (dimn_ports_file) parameter, which is more > > > general > > > than remote_guid_sorting. > > > > The route_port_ordering_file is capable of doing it, however the > > complexity of setting it up would be far past the knowledge base for the > > average system administrator. It would be far more difficult than > > setting up the 'guid_routing_order' file or 'dimn_ports_file' for DOR. > > > > To me, the generic 'route_port_ordering_file' is an option most useful > > for special cases. > > > > We've been using 'remote_guid_sorting' for almost a year now on multiple > > clusters. Without much effort, it gives all the clusters a nice 5-7% > > speedup. > > > > I understand that using guid_routing_order, improves performance. I just > think, that 'guid_routing_order' can bring benefit in a rear cases. What if > someone would think that reverse guid routing or any other function on peers > node GUIDs ports will improve its' performance, should we keep all of these > options?
Good point. I suppose we have to draw the line somewhere on cutting off options. We'll just keep the patch in-house b/c it'll be easier for the staff. Al > I created a simple script, that prepares route_port_ordering file from > ibnetdiscover. It sorts switches ports, based on a remote peer GUIDs. > It's pretty nit, but it does the job. > > #!/bin/bash > > IBNET_OUT="/tmp/port_ordering_ibnetdisocver" > TMP_FILE="/tmp/port_order_tmp" > > switch=0 > skip=0 > > `ibnetdiscover > $IBNET_OUT` > while read line > do > is_switch_header=`echo $line | grep -c ^Switch` > if [ $is_switch_header -eq 1 ]; then > guid=`echo $line | awk '{ print "0x" substr($3, 4, 16)}'` > switch=1 > skip=0 > elif [ $switch -eq 1 -a "$line" == "" ]; then > switch=0 > skip=1 > echo $guid `sort $TMP_FILE | awk '{print $2}' | xargs` > rm -fr $TMP_FILE > elif [ $switch -eq 1 ]; then > echo $line | grep "S-" | awk '{print "0x" substr($2, 4, 16) " " > substr($1,2,match($1,"]")-2)}' >> $TMP_FILE > fi > done < $IBNET_OUT > > rm -fr $IBNET_OUT > > -- Alex -- Albert Chu ch...@llnl.gov Computer Scientist High Performance Systems Division Lawrence Livermore National Laboratory -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html