Public bug reported: 2. Loaded cxgb4 driver (No t6-config.txt file) and brought up the interfaces.
3. Assigned IP address to Port0. # ifconfig ens6f4 102.10.10.3/24 up 4. Configured the traffic rate of 10 Gbps on queue 0 using the below command. # echo 10000 > /sys/class/net/ens6f4/queues/tx-0/tx_maxrate 5. Created a filter rule using tc flower to match traffic(destined to IP 102.10.10.120) and bind it to a Tx Queue 0 # tc qdisc add dev ens6f4 root handle 1: multiq # tc filter add dev ens6f4 parent 1: protocol ipv4 flower dst_ip 102.10.10.120 action skbedit queue_mapping 0 6. Traffic scenario, On PEER : netserver -4 On TM machine : 1. Sent traffic using below command, # rm -rf x ; for i in `seq 1 $N` ; do netperf -H 102.10.10.120 -l 30 >> x & done Observation : I could see very less throughput for more than 9 connections( ~500 Mbps). [root@buttercup ~]# tc -s filter show dev ens6f4 filter parent 1: protocol ip pref 49152 flower filter parent 1: protocol ip pref 49152 flower handle 0x1 eth_type ipv4 dst_ip 102.10.10.120 not_in_hw action order 1: skbedit queue_mapping 0 pipe index 1 ref 1 bind 1 installed 1924 sec used 1515 sec Action statistics: Sent 79221007872 bytes 52337820 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0 Throughput values ====================================== --------------------------------------------------------- | Number of connections | Throughput got in (Mbps) | --------------------------------------------------------- | 8 | 9489.85 | --------------------------------------------------------- | 9 | 9490.37 | --------------------------------------------------------- | 10 | 575.97 | --------------------------------------------------------- | 16 | 503.14 | --------------------------------------------------------- Environment ########################### [root@buttercup ~]# ethtool -i ens6f4 driver: cxgb4 version: 2.0.0-ko firmware-version: 1.24.3.0, TP 0.1.23.2 expansion-rom-version: bus-info: 0000:81:00.4 supports-statistics: yes supports-test: no supports-eeprom-access: yes supports-register-dump: yes supports-priv-flags: yes Adapter : T6425-CR rev 0 (S/N: RE03170007, P/N: 11012136002) Connectivity : Connected back-to-back with PEER T6225G-CR adapter. ** Affects: linux (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1879435 Title: [chelsio]cxgb4:Very less throughput with more than 9 connections when rate limit is applied Status in linux package in Ubuntu: New Bug description: 2. Loaded cxgb4 driver (No t6-config.txt file) and brought up the interfaces. 3. Assigned IP address to Port0. # ifconfig ens6f4 102.10.10.3/24 up 4. Configured the traffic rate of 10 Gbps on queue 0 using the below command. # echo 10000 > /sys/class/net/ens6f4/queues/tx-0/tx_maxrate 5. Created a filter rule using tc flower to match traffic(destined to IP 102.10.10.120) and bind it to a Tx Queue 0 # tc qdisc add dev ens6f4 root handle 1: multiq # tc filter add dev ens6f4 parent 1: protocol ipv4 flower dst_ip 102.10.10.120 action skbedit queue_mapping 0 6. Traffic scenario, On PEER : netserver -4 On TM machine : 1. Sent traffic using below command, # rm -rf x ; for i in `seq 1 $N` ; do netperf -H 102.10.10.120 -l 30 >> x & done Observation : I could see very less throughput for more than 9 connections( ~500 Mbps). [root@buttercup ~]# tc -s filter show dev ens6f4 filter parent 1: protocol ip pref 49152 flower filter parent 1: protocol ip pref 49152 flower handle 0x1 eth_type ipv4 dst_ip 102.10.10.120 not_in_hw action order 1: skbedit queue_mapping 0 pipe index 1 ref 1 bind 1 installed 1924 sec used 1515 sec Action statistics: Sent 79221007872 bytes 52337820 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0 Throughput values ====================================== --------------------------------------------------------- | Number of connections | Throughput got in (Mbps) | --------------------------------------------------------- | 8 | 9489.85 | --------------------------------------------------------- | 9 | 9490.37 | --------------------------------------------------------- | 10 | 575.97 | --------------------------------------------------------- | 16 | 503.14 | --------------------------------------------------------- Environment ########################### [root@buttercup ~]# ethtool -i ens6f4 driver: cxgb4 version: 2.0.0-ko firmware-version: 1.24.3.0, TP 0.1.23.2 expansion-rom-version: bus-info: 0000:81:00.4 supports-statistics: yes supports-test: no supports-eeprom-access: yes supports-register-dump: yes supports-priv-flags: yes Adapter : T6425-CR rev 0 (S/N: RE03170007, P/N: 11012136002) Connectivity : Connected back-to-back with PEER T6225G-CR adapter. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1879435/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp