These patches allow to have a specific QoS for Lustre traffic. - Patch 1 adds a new Lustre port space to the rdma_cm kernel module
- Patch 2 defines a new Lustre service ID (matching the new RDMA CMA port space) and a new 'lustre' keyword in the OpenSM QoS policy parser. - Patch 3 adds a new port_space parameter for the Lustre ko2iblnd kernel module that allows to specify the port space to be used by LNET. This patch has already been submitted to the Lustre community and is only given here as a reference. The relevant discussion is at https://bugzilla.lustre.org/show_bug.cgi?id=21732 In order the exercise QoS using this Lustre port space, the following setup may be used: 1. OpenSM configuration - etc/opensm/opensm.conf # # QoS OPTIONS # # Enable QoS setup qos TRUE # QoS policy file to be used qos_policy_file /etc/opensm/qospolicy.conf # QoS default options qos_max_vls 8 qos_high_limit 1 qos_vlarb_high 0:0,1:0,2:0,3:0,4:0,5:0 qos_vlarb_low 0:1,1:16,2:32,3:64,4:1,5:0 qos_sl2vl 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15 The VLARB weights are only indicative. 2. OpenSM QoS policy configuration - /etc/opensm/qos-policy.conf: qosulps default : 0 # default SL lustre, targetportguid 0x1234 : 1 # lustre traffic to a specific # port guid (ex MDS traffic) lustre : 2 # lustre default traffic endqosulps 3. Lustre module configuration - /etc/modprobe.d/lustre.conf Add the following line to all the Lustre nodes: options ko2iblnd port_space=339 Sebastien. -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html