RE: [PATCH 2.6.16-rc5] S2io: Receive packet classification and steering mechanisms
Hi, Just wondering if anybody got a chance to review below patch. Thanks, Ravi -Original Message- From: Ravinandan Arakali [mailto:[EMAIL PROTECTED] Sent: Friday, March 10, 2006 12:32 PM To: [EMAIL PROTECTED]; netdev@vger.kernel.org Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED] Subject: [PATCH 2.6.16-rc5] S2io: Receive packet classification and steering mechanisms Hi, Attached below is a patch to several receive packet classification and steering mechanisms for Xframe NIC hw channels. Current Xframe ASIC supports one hardware channel per CPU, up to 8 channels. This number will increase in the next ASIC release. A channel could be attached to a specific MSI-X vector (with an independent interrupt moderation scheme), which in turn can be bound to a CPU. Follow-up patches will provide some enhancements for the default tcp workload balancing across hw channels, as well as an optional hw channel interface. The interface is intended to be very generic (not specific to Xframe hardware). The following mechanisms are supported in this patch: Note: The steering type can be specified at load time with parameter rx_steering_type. Values supported are 1(port based), 2(RTH), 4(SPDM), 8(MAC addr based). 1. RTH(Receive traffic hashing): Steering is based on socket tuple (or a subset) and the popular Jenkins hash is used for RTH. This lets the receive processing to be spanned out to multiple CPUs, thus reducing single CPU bottleneck on Rx path. Hash-based steering can be used when it is desired to balance an unlimited number or TCP sessions across multiple CPUs but the exact mapping between a particular session and a particular cpu is not important. configuration: A mask(specified using loadable parameter rth_fn_and_mask) can be used to select a subset of TCP/UDP tuple for hash calculation. eg. To mask source port for TCP/IPv4 configuration, # insmod s2io.ko rx_steering_type=2 rth_fn_and_mask=0x0101 LSB specifies RTH function type and MSB the mask. A full description is provided at the beginning of s2io.c 2. port based: Steering is done based on source/destination TCP/UDP port number. configuration: Interface used is netlink sockets. Can specify port number(s), TCP/UDP type, source/destination port. 3. MAC address-based: Done based on destination MAC address of packet. Xframe can be configured with multiple unicast MAC addresses. configuration: Load-time parameters multi_mac_cnt and multi_macs can be used to specify no. of MAC addresses and list of unicast addresses. eg. insmod s2io.ko rx_steering_type=8 multi_mac_cnt=3 multi_macs=00:0c:fc:00:00:22, 00:0c:fc:00:01:22, 00:0c:fc:00:02:22 Packets received with default destination MAC address will be steered to ring0. Packets with destination MAC addresses specified by multi_macs are steered to ring1, ring2... respectively. 4. SPDM (Socket Pair Direct Match). Steering is based on exact socket tuple (or a subset) match. SPDM steering can be used when the exact mapping between a particular session and a particular cpu is desired. configuration: Interface used is netlink sockets. Can specify socket tuple values. If any of the values(say source port) needs to be "don't care", specify 0x. Signed-off-by: Raghavendra Koushik <[EMAIL PROTECTED]> Signed-off-by: Sivakumar Subramani <[EMAIL PROTECTED]> Signed-off-by: Ravinandan Arakali <[EMAIL PROTECTED]> --- diff -urpN old/drivers/net/rx_cfg.h new/drivers/net/rx_cfg.h --- old/drivers/net/rx_cfg.h1969-12-31 16:00:00.0 -0800 +++ new/drivers/net/rx_cfg.h2006-03-10 02:54:56.0 -0800 @@ -0,0 +1,44 @@ +#ifndef _RX_CFG_H_ +#define_RX_CFG_H_ + +typedef struct { + unsigned short port; + unsigned short prot_n_type; /* TCP/UDP & Dst/Src port type */ +#defineSRC_PRT 0x0 +#defineDST_PRT 0x1 +#defineTCP_PROT0x0 +#defineUDP_PROT0x1 + unsigned short dst_ring; +}port_info_t; + +/* A Rx steering config structure to pass info the driver by user */ +typedef struct { + //SPDM + unsigned intsip; /* Src IP addr */ + unsigned intdip; /* Dst IP addr */ + unsigned short sprt; /* Src TCP port */ + unsigned short dprt; /* Dst TCP port */ + unsigned intt_queue; /*Target Rx Queue for the packet */ + unsigned inthash; /* the hash as per jenkin's hash algorithm. */ +#define SPDM_NO_DATA 0x1 +#define SPDM_XENA_IF 0x2 +#define SPDM_HW_UNINITIALIZED 0x3 +#define SPDM_INCOMPLETE_SOCKET 0x4 +#define SPDM_TABLE_ACCESS_FAILED 0x5 +#define SPDM_TABLE_FULL0x6 +#define SPDM_TABLE_UNKNOWN_BAR 0x7 +#define SPDM_TABLE_MALLOC_FAIL 0x8 +#defineSPDM_INVALID_DEVICE 0x9 +#define SPDM_CONF_SUCCESS 0x0 +#defineSPDM_GET_CFG_DATA 0xAA55 +
RE: [PATCH 2.6.16-rc5] S2io: Receive packet classification and steering mechanisms
Hi Jeff, Any comments on the below patch ? Thanks, Ravi -Original Message- From: Ravinandan Arakali [mailto:[EMAIL PROTECTED] Sent: Friday, March 10, 2006 12:32 PM To: [EMAIL PROTECTED]; netdev@vger.kernel.org Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED] Subject: [PATCH 2.6.16-rc5] S2io: Receive packet classification and steering mechanisms Hi, Attached below is a patch to several receive packet classification and steering mechanisms for Xframe NIC hw channels. Current Xframe ASIC supports one hardware channel per CPU, up to 8 channels. This number will increase in the next ASIC release. A channel could be attached to a specific MSI-X vector (with an independent interrupt moderation scheme), which in turn can be bound to a CPU. Follow-up patches will provide some enhancements for the default tcp workload balancing across hw channels, as well as an optional hw channel interface. The interface is intended to be very generic (not specific to Xframe hardware). The following mechanisms are supported in this patch: Note: The steering type can be specified at load time with parameter rx_steering_type. Values supported are 1(port based), 2(RTH), 4(SPDM), 8(MAC addr based). 1. RTH(Receive traffic hashing): Steering is based on socket tuple (or a subset) and the popular Jenkins hash is used for RTH. This lets the receive processing to be spanned out to multiple CPUs, thus reducing single CPU bottleneck on Rx path. Hash-based steering can be used when it is desired to balance an unlimited number or TCP sessions across multiple CPUs but the exact mapping between a particular session and a particular cpu is not important. configuration: A mask(specified using loadable parameter rth_fn_and_mask) can be used to select a subset of TCP/UDP tuple for hash calculation. eg. To mask source port for TCP/IPv4 configuration, # insmod s2io.ko rx_steering_type=2 rth_fn_and_mask=0x0101 LSB specifies RTH function type and MSB the mask. A full description is provided at the beginning of s2io.c 2. port based: Steering is done based on source/destination TCP/UDP port number. configuration: Interface used is netlink sockets. Can specify port number(s), TCP/UDP type, source/destination port. 3. MAC address-based: Done based on destination MAC address of packet. Xframe can be configured with multiple unicast MAC addresses. configuration: Load-time parameters multi_mac_cnt and multi_macs can be used to specify no. of MAC addresses and list of unicast addresses. eg. insmod s2io.ko rx_steering_type=8 multi_mac_cnt=3 multi_macs=00:0c:fc:00:00:22, 00:0c:fc:00:01:22, 00:0c:fc:00:02:22 Packets received with default destination MAC address will be steered to ring0. Packets with destination MAC addresses specified by multi_macs are steered to ring1, ring2... respectively. 4. SPDM (Socket Pair Direct Match). Steering is based on exact socket tuple (or a subset) match. SPDM steering can be used when the exact mapping between a particular session and a particular cpu is desired. configuration: Interface used is netlink sockets. Can specify socket tuple values. If any of the values(say source port) needs to be "don't care", specify 0x. Signed-off-by: Raghavendra Koushik <[EMAIL PROTECTED]> Signed-off-by: Sivakumar Subramani <[EMAIL PROTECTED]> Signed-off-by: Ravinandan Arakali <[EMAIL PROTECTED]> --- - To unsubscribe from this list: send the line "unsubscribe netdev" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: [PATCH 2.6.16-rc5] S2io: Receive packet classification and steering mechanisms
On Wednesday 19 April 2006 02:38, Ravinandan Arakali wrote: > configuration: A mask(specified using loadable parameter rth_fn_and_mask) > can be used to select a subset of TCP/UDP tuple for hash calculation. > eg. To mask source port for TCP/IPv4 configuration, > # insmod s2io.ko rx_steering_type=2 rth_fn_and_mask=0x0101 > LSB specifies RTH function type and MSB the mask. A full description > is provided at the beginning of s2io.c I don't think it's a good idea to introduce such weird and hard to understand module parameters for this. I would be better to define a generic internal kernel interface between stack and driver. Perhaps starting with a standard netlink interface for this might be a good start until the stack learns how to use this on its own. > 3. MAC address-based: > Done based on destination MAC address of packet. Xframe can be > configured with multiple unicast MAC addresses. > > configuration: Load-time parameters multi_mac_cnt and multi_macs > can be used to specify no. of MAC addresses and list of unicast > addresses. > eg. insmod s2io.ko rx_steering_type=8 multi_mac_cnt=3 > multi_macs=00:0c:fc:00:00:22, 00:0c:fc:00:01:22, 00:0c:fc:00:02:22 > Packets received with default destination MAC address will be steered to > ring0. Packets with destination MAC addresses specified by multi_macs are > steered to ring1, ring2... respectively. The obvious way to do this nicely would be to allow to define multiple virtual interfaces where the mac addresses can be set using the usual ioctls. -Andi - To unsubscribe from this list: send the line "unsubscribe netdev" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html
RE: [PATCH 2.6.16-rc5] S2io: Receive packet classification and steering mechanisms
Andi, We would like to explain that this patch is tier-1 of a two tiered approach. It implements all the steering functionality at driver-only level, and it is fairly Neterion-specific. The second upcoming submission will add a generic netlink-based interface for channel data flow and configuration(including receive steering parameters) on per-channel basis, that will utilize the lower level implementation from the current patch. Thanks, Ravi -Original Message- From: Andi Kleen [mailto:[EMAIL PROTECTED] Sent: Tuesday, April 18, 2006 5:59 PM To: [EMAIL PROTECTED] Cc: [EMAIL PROTECTED]; netdev@vger.kernel.org Subject: Re: [PATCH 2.6.16-rc5] S2io: Receive packet classification and steering mechanisms On Wednesday 19 April 2006 02:38, Ravinandan Arakali wrote: > configuration: A mask(specified using loadable parameter rth_fn_and_mask) > can be used to select a subset of TCP/UDP tuple for hash calculation. > eg. To mask source port for TCP/IPv4 configuration, > # insmod s2io.ko rx_steering_type=2 rth_fn_and_mask=0x0101 > LSB specifies RTH function type and MSB the mask. A full description > is provided at the beginning of s2io.c I don't think it's a good idea to introduce such weird and hard to understand module parameters for this. I would be better to define a generic internal kernel interface between stack and driver. Perhaps starting with a standard netlink interface for this might be a good start until the stack learns how to use this on its own. > 3. MAC address-based: > Done based on destination MAC address of packet. Xframe can be > configured with multiple unicast MAC addresses. > > configuration: Load-time parameters multi_mac_cnt and multi_macs > can be used to specify no. of MAC addresses and list of unicast > addresses. > eg. insmod s2io.ko rx_steering_type=8 multi_mac_cnt=3 > multi_macs=00:0c:fc:00:00:22, 00:0c:fc:00:01:22, 00:0c:fc:00:02:22 > Packets received with default destination MAC address will be steered to > ring0. Packets with destination MAC addresses specified by multi_macs are > steered to ring1, ring2... respectively. The obvious way to do this nicely would be to allow to define multiple virtual interfaces where the mac addresses can be set using the usual ioctls. -Andi - To unsubscribe from this list: send the line "unsubscribe netdev" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: [PATCH 2.6.16-rc5] S2io: Receive packet classification and steering mechanisms
On Thursday 20 April 2006 00:45, Ravinandan Arakali wrote: > Andi, > We would like to explain that this patch is tier-1 of a two > tiered approach. It implements all the steering > functionality at driver-only level, and it is fairly Neterion-specific. That's fine for experiments, but probably not something that should be in tree. > > The second upcoming submission will add a generic netlink-based > interface for channel data flow and configuration(including receive steering > parameters) on per-channel basis, that will utilize the lower level > implementation from the current patch. Will the driver itself listening to netlink? My feeling would be to teach the stack to use this would require efficient interfaces and netlink isn't particularly. But if it's just a glue module outside the driver that would be reasonable as a first step I guess. Do you also plan to release user tools to use it? -Andi - To unsubscribe from this list: send the line "unsubscribe netdev" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html
RE: [PATCH 2.6.16-rc5] S2io: Receive packet classification and steering mechanisms
Andi, The driver will be polling(listening) to netlink for any configuration requests. We could release the user tools but not sure where(in the tree) they would reside. Thanks, Ravi -Original Message- From: Andi Kleen [mailto:[EMAIL PROTECTED] Sent: Wednesday, April 19, 2006 5:51 PM To: [EMAIL PROTECTED] Cc: [EMAIL PROTECTED]; netdev@vger.kernel.org Subject: Re: [PATCH 2.6.16-rc5] S2io: Receive packet classification and steering mechanisms On Thursday 20 April 2006 00:45, Ravinandan Arakali wrote: > Andi, > We would like to explain that this patch is tier-1 of a two > tiered approach. It implements all the steering > functionality at driver-only level, and it is fairly Neterion-specific. That's fine for experiments, but probably not something that should be in tree. > > The second upcoming submission will add a generic netlink-based > interface for channel data flow and configuration(including receive steering > parameters) on per-channel basis, that will utilize the lower level > implementation from the current patch. Will the driver itself listening to netlink? My feeling would be to teach the stack to use this would require efficient interfaces and netlink isn't particularly. But if it's just a glue module outside the driver that would be reasonable as a first step I guess. Do you also plan to release user tools to use it? -Andi - To unsubscribe from this list: send the line "unsubscribe netdev" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html