Re: Chelsio NIC with RSS - Traffic distribution to different Queues

On 7/10/23 2:36 AM, josef.zahn...@swisscom.com wrote: Ok we are getting closer to a solution. But I’m a little bit confused, I’ll try to explain why. I’ve removed the following sysctl values, as you stated that they are not official FreeBSD values: -net.inet.rss.bits="2"

Re: Chelsio NIC with RSS - Traffic distribution to different Queues

On Mon, Jul 3, 2023 at 8:48 AM wrote: > > Sorry for the spam, I do see the values with sysctl now. It seems that > FreeBSD always loads the if_cxgbe.ko from /boot/kernel/if_cxgbe.ko. So what > I’ve done is, I renamed the original file and copied the newly compiled > if_cxgbe.ko from

Re: Chelsio NIC with RSS - Traffic distribution to different Queues

Hello, Please try this patch: https://people.freebsd.org/~np/norssq.diff It adds these sysctls to the driver. 1) hw.cxgbe.rsrv_norssq. This is what you originally asked for. 2) hw.cxgbe.rx_budget. This can be used to force the driver's RX to yield periodically. What kind of system (cores,

Re: Chelsio NIC with RSS - Traffic distribution to different Queues

On 6/27/23 12:47 AM, josef.zahn...@swisscom.com wrote: We are familiar with «hw.cxgbe.rsrv_noflowq», but as you already stated it’s only for TX direction, it doesn’t help us at all. Okay. Our problem is in fact, that on FreeBSD only CPU0 seems to do the slow protocol (LACP, CARP,…) stuff and

Re: Chelsio NIC with RSS - Traffic distribution to different Queues

On Mon, Jun 26, 2023 at 5:58 AM wrote: > > Hi guys > > > > I’m trying to do something similar like in the question here > (https://lists.freebsd.org/pipermail/freebsd-net/2017-March/047378.html). We > have Chelsio NICs (T580-LP-CR). > > > > Our goal is the following: > > RSS Queue 0 -> only

Re: FreeBSD 12.2 traffic not occurs onVXLAN

On Tue, Aug 24, 2021 at 1:12 AM alfadev wrote: > > Thanks for interest > FreeBSD ifconfig: > > igb0: flags=8822 metric 0 mtu 1500 ... > wg0: flags=80c1 metric 0 mtu 1420 igb0 should be UP and RUNNING before it will pass traffic. You can see that the wireguard interface is fully operational (has

Re: FreeBSD 12.2 traffic not occurs onVXLAN

On Sun, Aug 22, 2021 at 8:30 AM alfadev via freebsd-hackers wrote: > > Hi, I successfully configured VXLAN tunnel between amd64 FreeBSD 11.2 to x64 > Linux > But in FreeBSD 12.2 with below same configuration not works. > So What is tHe problem with FreeBSD 12.2 is it bug or any other thing? >

Re: RFC: NFS trunking (multiple TCP connections for a mount

On Mon, Jun 28, 2021 at 5:23 PM Rick Macklem wrote: > > The Linux NFS client now has a mount option "nconnect", > which specifies that multiple TCP connections be created > for an NFS mount, where RPCs are done on the connections, > in a round robin fashion. (Alternating between the two TCP >

Re: How to Increase TX Queue Priority for LACP Packets

on . Does this put the nics >into promiscuous mode ? > --- > Mark Saad | mark.s...@lucera.com > > > On Jun 16, 2020, at 8:13 PM, Navdeep Parhar wrote: > > > > We could have a global knob that tells all NIC drivers to use a reserved > > queue for non-RS

Re: How to Increase TX Queue Priority for LACP Packets

t; --- > Mark Saad > mark.s...@lucera.com > > > > From: owner-freebsd-...@freebsd.org on behalf > of Foster, Greg > Sent: Tuesday, June 16, 2020 3:56 PM > To: Navdeep Parhar > Cc: freebsd-net@freebsd.org > Subject: RE:

Re: How to Increase TX Queue Priority for LACP Packets

ards, Navdeep > > Thanks > Greg > > -Original Message----- > From: Navdeep Parhar On Behalf Of Navdeep Parhar > Sent: Friday, June 12, 2020 7:51 PM > To: Foster, Greg > Cc: freebsd-net@freebsd.org > Subject: Re: How to Increase TX Queue Priority for LACP Pack

Re: Chelsio NETMAP performance

On Wed, Feb 05, 2020 at 02:38:32PM +0300, Slawa Olhovchenkov wrote: > On Tue, Feb 04, 2020 at 12:37:08PM -0800, Navdeep Parhar wrote: > > > >> nm_holdoff_tmr_idx is a 0-based index into the list above. So if the > > >> tmr idx is 0 you are using the 0

Re: Chelsio NETMAP performance

On 2/4/20 8:20 AM, Slawa Olhovchenkov wrote: > On Mon, Feb 03, 2020 at 02:39:03PM -0800, Navdeep Parhar wrote: > >> On 2/3/20 2:23 PM, Slawa Olhovchenkov wrote: >>> On Mon, Feb 03, 2020 at 01:39:52PM -0800, Navdeep Parhar wrote: >>> >>>> On 2/3/20 12:1

Re: Chelsio NETMAP performance

On 2/3/20 2:23 PM, Slawa Olhovchenkov wrote: > On Mon, Feb 03, 2020 at 01:39:52PM -0800, Navdeep Parhar wrote: > >> On 2/3/20 12:17 PM, Slawa Olhovchenkov wrote: >>> I am try to use Chelsio T540-CR in netmap mode and see poor (compared >>> to Intel 82599ES) perfo

Re: Chelsio NETMAP performance

On 2/3/20 12:17 PM, Slawa Olhovchenkov wrote: > I am try to use Chelsio T540-CR in netmap mode and see poor (compared > to Intel 82599ES) performance. What approximate FreeBSD version is this? > > Same application ac receive only about 8.9Mpss, compared to 12.5Mpps > at Intel. > > pmc profile

Re: unexplained latency, interrupt spikes and loss of throughput on FreeBSD router/firewall system

On 1/15/20 6:55 AM, John Jasen wrote: > Executive summary: > > Periodically, load will spike on network interrupts on one of our > firewalls. Latency will quickly climb to the point that things are > unresponsive, sessions will timeout, and bandwidth will plummet. Is this with 9000 MTU? Can you

Re: logs/traces

Have you looked at siftr(4) or dtrace_tcp(4)? Regards, Navdeep On Tue, Oct 15, 2019 at 07:15:27PM -0700, vm finance wrote: > Hi Kevin, > > I am looking to enable traces/log messages (like syslog or > /var/log/messages) inside the codebase... any pointers for tcp/ip. > tcpdump shows what is

Re: Chelsio TOE not working in CURRENT

Fixed in r345701. On 2019-03-28 22:59, Dustin Marquess wrote: > On a brand new CURRENT Chelsio (cxl) TOE doesn't work, as loading the > dependent t4_tom module fails: > > If VIMAGE is enabled: > > link_elf_obj: symbol vnet_entry_tcp_autorcvbuf_inc undefined > linker_load_file:

Re: netmap on cxgb (Chelsio T3) — panic on transmit

On 11/22/18 7:30 AM, Lev Serebryakov wrote: > > I've obtained Chelsio T3 for my "network lab". It works with cxgb > driver well, but when I try to use Netmap's pkt-gen on it it crashes > system immediately with such message: > > panic: trying to coalesce 9 packets in to one WR > > I've turned

Re: cxl nic not working after reboot

On 8/30/18 3:14 PM, Navdeep Parhar wrote: > On 8/30/18 2:51 PM, Marius Halden wrote: >> On Thu, Aug 30, 2018, at 19:27, Navdeep Parhar wrote: >>> On 8/30/18 4:21 AM, Marius Halden wrote: >>>> I tried to downgrade to a the previous bsdrp version we were running b

Re: cxl nic not working after reboot

On 8/30/18 2:51 PM, Marius Halden wrote: > On Thu, Aug 30, 2018, at 19:27, Navdeep Parhar wrote: >> On 8/30/18 4:21 AM, Marius Halden wrote: >>> I tried to downgrade to a the previous bsdrp version we were running based >>> on 11.1-RELEASE-p10, but it did not start wor

Re: cxl nic not working after reboot

On 8/30/18 4:21 AM, Marius Halden wrote: > On Wed, Aug 29, 2018, at 12:22, Marius Halden wrote: >> On Wed, Aug 29, 2018, at 08:28, Navdeep Parhar wrote: >>>>>> Provide the output of these commands when the link isn't up: >>>>>> # ifconfig -mvv

Re: cxl nic not working after reboot

On 8/28/18 12:30 PM, Marius Halden wrote: > On Tue, Aug 28, 2018, at 20:32, Navdeep Parhar wrote: >> On 8/28/18 11:27 AM, Marius Halden wrote: >>> On Tue, Aug 28, 2018, at 20:06, Navdeep Parhar wrote: >>>> On 8/28/18 2:35 AM, Marius Halden wrote: >>>>

Re: cxl nic not working after reboot

On 8/28/18 11:27 AM, Marius Halden wrote: > On Tue, Aug 28, 2018, at 20:06, Navdeep Parhar wrote: >> On 8/28/18 2:35 AM, Marius Halden wrote: >>> ... >>> media: Ethernet 1000baseSX >>> status: active >>> supported media: >>>

Re: cxl nic not working after reboot

On 8/28/18 2:35 AM, Marius Halden wrote: > ... > media: Ethernet 1000baseSX > status: active > supported media: > media 1000baseSX mediaopt full-duplex,rxpause,txpause > media 1000baseSX mediaopt full-duplex,rxpause > media 1000baseSX mediaopt

Re: cxl nic not working after reboot

On Mon, Aug 27, 2018 at 04:19:29PM +0200, Marius Halden wrote: > Hi, > > We have some routers with Chelsio T540-CR NICs using 1Gbps SFPs (1000 > Base-LX IIRC) to connect to our ISPs. After upgrading them to FreeBSD > 11.2-p2 (BSDRP v1.91) we have run into some issues. When the machines > are

Re: netmap & chelsio

On 07/11/18 07:58, Eggert, Lars wrote: > Hi, > > I have netmap working with the T6 cards now. > > However, performance is very poor. It seems to take several milliseconds > after a NIOCTXSYNC ioctl before the tail is updated? Try changing lazy_tx_credit_flush to 0 on the running kernel with a

Re: fix for some netmap drivers

Done in r329675. On Mon, 2018-02-19 at 16:41 +0100, Vincenzo Maffione wrote: > Hello, > Can anyone please apply the attached patch? It follows up the > removal of the nkr_slot_flags in the upstream netmap. > The change fixes compilation issues and has no effect on > functionality. > > Thanks,

Re: [freebsd-current]Who should reset M_PKTHDR flag in m_buf when IP packets are fragmented. m_unshare panic throw when IPSec is enabled

On 12/27/2017 12:59, Andrey V. Elsukov wrote: On 27.12.2017 23:09, Navdeep Parhar wrote: It is not clear to me why it helps. The panic happens on outbound path, where mbuf should be allocated by network stack and should be writeable. ip_reass() usually used on inbound path. I think the patch

Re: [freebsd-current]Who should reset M_PKTHDR flag in m_buf when IP packets are fragmented. m_unshare panic throw when IPSec is enabled

On 12/26/2017 03:33, Andrey V. Elsukov wrote: On 26.12.2017 13:22, Harsh Jain wrote: panic: m_unshare: m0 0xf80020f82600, m 0xf8005d054100 has M_PKTHDR cpuid = 15 time = 1495578455 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2c/frame 0xfe044e9bb890

Re: packets per second routing tests: mismatch between switch (~4M pps) and netstat (~10M pps) scores

The tx errors/drops are almost always due to software queue overflow. There isn't much that can go wrong once the frame has successfully been submitted to the hw for tx. Do you have a lot of PAUSE coming in during the tests where you see just 31Kpps tx? You can monitor the incoming PAUSE frames

Re: Sporadic TCP/RST sent to client

On Thu, Jun 22, 2017 at 3:57 PM, Youssef GHORBAL wrote: > Hello, > > I'm having an issue with a FreeBSD 11 based system, sending > sporadically TCP/RST to clients after initial TCP session correctly initiated. > The sequence goes this way : > >

Re: state of packet forwarding in FreeBSD?

On 06/14/2017 10:42, Olivier Cochard-Labbé wrote: On Wed, Jun 14, 2017 at 7:36 PM, Navdeep Parhar <npar...@gmail.com <mailto:npar...@gmail.com>> wrote: I think I fixed this a long time back. Have you tried recently? We moved the netmap functionality to the vcx

Re: state of packet forwarding in FreeBSD?

Do you mean it works with one pkt-gen but panics when the second one is started? On Wed, Jun 14, 2017 at 10:42 AM, Olivier Cochard-Labbé <oliv...@freebsd.org> wrote: > On Wed, Jun 14, 2017 at 7:36 PM, Navdeep Parhar <npar...@gmail.com> wrote: >> >> >> I think I f

Re: state of packet forwarding in FreeBSD?

On Wed, Jun 14, 2017 at 8:21 AM, Olivier Cochard-Labbé wrote: > On Wed, Jun 14, 2017 at 4:48 PM, John Jasen wrote: > >> >> b) On the negative side, between the various releases, netmap appeared >> to be unstable with the Chelsio cards -- sometimes

Re: tools/netmap/pkt-gen: clang error

You can suppress the warning with something like this: # cd /usr/src/tools/tools/netmap # WARNS=2 make Regards, Navdeep On Tue, May 30, 2017 at 10:54 AM, Harry Schmalzbauer wrote: > Hello, > > after merging netmap code from head I can't compile pkt-gen from >

Re: cxgbe netmap promiscuous mode?

that has already been fixed in the 1.16.x firmware available in 10-STABLE. Regards, Navdeep On 19/04/17 15:37, Navdeep Parhar wrote: What is the firmware version? # sysctl dev.t5nex.0.firmware_version I'll try to repeat the experiment with a T520-SO with the firmware that you have on your card

Re: cxgbe netmap promiscuous mode?

On Mon, Apr 17, 2017 at 11:00:38AM +0100, Joe Jones wrote: > Hi Navdeep > > running "ifconfig up" and then "ifconfig promisc" works. Running "ifconfig > promisc" and then "ifconfig up" does not work. Running "ifconfig up promisc" > together does work. Running "ifconfig promisc up" does not work.

Re: cxgbe netmap promiscuous mode?

On Fri, Apr 14, 2017 at 04:10:59PM +0100, Joe Jones wrote: > Hi Navdeep, > > I think I have found a driver bug. Earlier today I set up the switch I'm > using so that two of the ports mirror the traffic on one of the other ports. > We are planning on using a similar setup to allow packet tracing

Re: TSO and packets accounting

On Sun, Mar 26, 2017 at 01:39:30AM +0300, Slawa Olhovchenkov wrote: > How to acoount output packets w/ TSO? > I mean as one large packet. What I see: > > # netstat -nbI lagg0 1 > input lagg0 output >packets errs idrops bytespackets errs bytes

Re: bad throughput performance on multiple systems: Re: Fwd: Re: Disappointing packets-per-second performance results on a Dell,PE R530

s. Are you sure you aren't getting PAUSE frames out of the chip? There's nothing else that could slow down UDP senders. # sysctl -a | grep tx_pause Regards, Navdeep On 3/24/17 7:39 PM, Navdeep Parhar wrote: On 03/24/2017 16:07, Caraballo-vega, Jordan A. (GSFC-6062)[COMPUTER SCI

Re: bad throughput performance on multiple systems: Re: Fwd: Re: Disappointing packets-per-second performance results on a Dell,PE R530

Vicenzo email thread hw.cxgbe.num_vis=2 hw.cxgbe.fl_pktshift=0 hw.cxgbe.toecaps_allowed=0 hw.cxgbe.nnmtxq10g=8 hw.cxgbe.nnmrxq10g=8 /etc/sysctl.conf configurations # Turning off pauses dev.cxl.0.pause_settings=0 dev.cxl.1.pause_settings=0 # John Jasen suggestion - March 24, 2017 net.isr.bindt

Re: Committing a new 25G/40G/100G Ethernet Driver

On 03/23/2017 19:39, Somayajulu, David wrote: Hi All, I have a brand new Cavium 25G/40G/100G Ethernet Driver to commit to HEAD. The patch generated using "svn diff" is about 22Mb. Per gnn's advice I have tried to submit the patch via Phabricator at

Re: cxgbe netmap promiscuous mode?

On Fri, Mar 24, 2017 at 6:40 AM, Joe Jones wrote: > Hello Navdeep, > > ... > > We were using our own MACs, we can fix the problem by using the mac from the > vcxl interface. Should we not be able to capture all traffic on the > interface regardless of what

Re: cxgbe netmap promiscuous mode?

Your netmap application should be using the 'vcxl' interface, not the cxl interface. Even though they share a physical port they have different MAC addresses and are totally autonomous. The peer should use the vcxl interface's MAC if it wants to reach the netmap application. Do you have the

Re: bad throughput performance on multiple systems: Re: Fwd: Re: Disappointing packets-per-second performance results on a Dell,PE R530

On Fri, Mar 17, 2017 at 11:43:32PM -0400, John Jasen wrote: > On 03/17/2017 03:32 PM, Navdeep Parhar wrote: > > > On Fri, Mar 17, 2017 at 12:21 PM, John Jasen <jja...@gmail.com> wrote: > >> Yes. > >> We were hopeful, initially, to be able to achieve higher

Re: bad throughput performance on multiple systems: Re: Fwd: Re: Disappointing packets-per-second performance results on a Dell,PE R530

t; >>> Following down leads that 11-STABLE had tryforward improvements over >>> 11-RELENG, I upgraded. The same tests (24 client streams over UDP with >>> small packets), the system went from passing 1.7m pps to about 2.5m. >>> >>> Following indication

Re: bad throughput performance on multiple systems: Re: Fwd: Re: Disappointing packets-per-second performance results on a Dell,PE R530

On Mon, Mar 13, 2017 at 10:13 AM, John Jasen <jja...@gmail.com> wrote: > On 03/13/2017 01:03 PM, Navdeep Parhar wrote: > >> On Sun, Mar 12, 2017 at 5:35 PM, John Jasen <jja...@gmail.com> wrote: >>> UDP traffic. dmesg reports 16 txq, 8 rxq -- which is the defaul

Re: bad throughput performance on multiple systems: Re: Fwd: Re: Disappointing packets-per-second performance results on a Dell,PE R530

On Sun, Mar 12, 2017 at 5:35 PM, John Jasen wrote: > > UDP traffic. dmesg reports 16 txq, 8 rxq -- which is the default for > Chelsio. > I don't recall offhand, but UDP might be using 2-tuple hashing by default and that might affect the distribution of flows across queues. Are

Re: Chelsio netmap support ? (RELENG_11)

On Wed, Mar 8, 2017 at 6:28 AM, Mike Tancsa <m...@sentex.net> wrote: > On 3/7/2017 9:08 PM, Navdeep Parhar wrote: >> On Tue, Mar 7, 2017 at 5:46 PM, Mike Tancsa <m...@sentex.net> wrote: >> >>> >>> # dmesg | grep netm >>> netmap: loaded modul

Re: Chelsio netmap support ? (RELENG_11)

On Tue, Mar 7, 2017 at 5:46 PM, Mike Tancsa wrote: > > # dmesg | grep netm > netmap: loaded module > vcxl0: netmap queues/slots: TX 2/1023, RX 2/1024 > vcxl0: 1 txq, 1 rxq (NIC); 1 txq, 1 rxq (TOE); 2 txq, 2 rxq (netmap) > vcxl1: netmap queues/slots: TX 2/1023, RX 2/1024 >

Re: Chelsio netmap support ? (RELENG_11)

On Tue, Mar 7, 2017 at 1:53 PM, Mike Tancsa wrote: ... > > Using netsend, I cant seem to blast through a single flow of packets > greater than 800Kpps without packet loss. Can you point me to any > performance tweaks for forwarding / routing ? > > I have 3 boxes, with one in the

Re: Chelsio netmap support ? (RELENG_11)

On Tue, Mar 7, 2017 at 12:21 PM, Navdeep Parhar <npar...@gmail.com> wrote: > Is it possible for you to run 10-STABLE? I meant 11-STABLE of course. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/fr

Re: Chelsio netmap support ? (RELENG_11)

Is it possible for you to run 10-STABLE? The netmap support in cxgbe was enhanced and uses the general purpose 'vcxl' interfaces now. You can enable them with hw.cxgbe.num_vis=2 in loader.conf. If -STABLE is not an option then check if you built your kernel with device NETMAP. config -x

Re: RSS, cxgbe, netmap and non-TCP traffic

On Mon, Mar 06, 2017 at 11:10:21AM +0100, Miłosz Kaniewski wrote: > Hello, > > I am trying to split my traffic into two flows: > 1. TCP traffic > 2. Other traffic (non-TCP traffic) > > On my NIC (Chelsio T540-CR) I have configured 9 queues (these are > Netmap queues configured with

Re: ifmedia status callback is non-sleepable

I think it's a bad idea in general for the kernel to be holding non-sleepable locks around driver ioctls. Regards, Navdeep On Thu, Jan 26, 2017 at 9:19 AM, Andrew Rybchenko wrote: > Hello, > > I'd like to double-check that it is intended/known limitation on ifmedia >

Re: cxgbe's native netmap support broken since r307394

o have an "unified" > locking scheme, i.e. always calling nm_hw_register under the lock. > > Does this make sense to you? Would it be easy for you to make a quick > test by replacing IFNET_WLOCK with IFNET_RLOCK? > > Thanks, > Vincenzo > > 2016-12-17 23:28 GMT+01

Re: netmap, netmap-fwd, and how many M packets-per-second?

How have you configured netmap-fwd? If you provide details on how the router or firewall is setup I can try similar experiments here. On Thu, Dec 1, 2016 at 3:55 PM, Jordan Caraballo wrote: > Feedback and/or tips and tricks more than welcome. > > We are trying to

Re: unable to use BPF Just-In-Time compiler

Use "options BPF_JITTER" in your kernconf. If this is new code you must include opt_bpf.h in it. If it's part of a module then the module's makefile must have opt_bpf.h in its SRCS. When in doubt take a look at all the obt_bpf.h in your obj tree after the buildkernel and see if they have

Re: Netmap Checksum Offloading

On 06/15/2016 16:15, Andrey Yakovlev wrote: > ive heard on bsdcan this year that some patches exist to add hwcsum > offloading to netmap, hope to see it chelsio at least cxgbe/cxl is a bit sneaky and will let you override netmap (on tx only). The ncxl interfaces declare themselves capable of

Re: Changing MTU on cxgbe

On Fri, May 27, 2016 at 12:23:02AM -0700, K. Macy wrote: > On Thursday, May 26, 2016, Navdeep Parhar <npar...@gmail.com> wrote: > > > On Fri, May 27, 2016 at 12:57:34AM -0400, Garrett Wollman wrote: > > > In article < > > cajpshy4vf5ky6guausloorogiquyd

Re: Changing MTU on cxgbe

On Fri, May 27, 2016 at 12:57:34AM -0400, Garrett Wollman wrote: > In article > you > write: > > ># ifconfig -m cxgbe0 > >cxgbe0: flags=8943 > > ># ifconfig cxgbe0 mtu 9000 >

Re: Changing MTU on cxgbe

On Thu, May 26, 2016 at 11:52:45PM -0500, Dustin Marquess wrote: > After my many issues with ixgbe & ixv, I ended up removing the Intel > X520s with Chelsio T420-CR and the Intel X710s with Chelsio T520-CR. > So far so good, except I can't seem to change the MTU away from 1500. > In fact, ifconfig

Re: Software iWARP on FreeBSD

On 05/20/2016 09:36, Vijay Singh wrote: > Hello. I'm looking to have software iWARP working on FreeBSD (kernel mode > for now). Bernard and his team have an implementation: > https://github.com/zrlio/softiwarp/tree/master/kernel. It has been released > under the BSD license. Currently it is

Re: netmap overrun counters

On 04/28/2016 11:13, bazzoola wrote: > Hi! > > Two questions: > > (1) Is there a way to know when netmap rx rings overrun? Most NIC > drivers provide MPC (missed packet count) and sysctl for rx_overrun. > > I would like to know if my application is not reading as fast, i.e., no > frames are

Re: Netmap seems to randomly cause Kernel panic on shutdown

On 04/05/2016 01:30, Steven Crangle wrote: > > Hi, > > > I'm looking for a bit of help to track down the reason behind this > kernel panic, it seems like netmap works fine for the majority of the > time, but occasionally it will cause the box to kernel panic. > > > The machine is running

Re: Tracing dropped UDP packets

On 04/15/2016 22:38, bazzoola wrote: > Greetings, > > I would like to know where (in the kernel) UDP packets are dropped. Have you tried netstat -sp udp ? If the drops show up in some counter there then you can look at the kernel code to see where the counter is incremented. Regards, Navdeep

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

On Sat, Jan 23, 2016 at 03:48:39PM -0200, Marcus Cenzatti wrote: ... > > woops, my bad, yes probably we had some drop, with -S and -D now I get > 1.2Mpps. Run "netstat -hdw1 -i cxl" on the receiver during your test. Do you see errs and/or idrops incrementing? The input "packets" counter

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

On Sat, Jan 23, 2016 at 03:12:59PM -0200, Marcus Cenzatti wrote: ... > intel# ./pkt-gen -i ix0 -f tx -d 00:07:43:33:8d:c1 -s 00:07:e9:44:d2:ba > 267.767848 main [1715] interface is ix0 > 267.767990 extract_ip_range [291] range is 0.0.0.0:90 to 0.0.0.0:90 > 267.768006 extract_ip_range [291] range

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

On Sat, Jan 23, 2016 at 04:54:52PM -0200, Marcus Cenzatti wrote: ... > here is the output for netstat when I pkt-gen -f tx un-throttled (14Mpps): > > input(Total) output >packets errs idrops bytespackets errs bytes colls drops > 900k 0

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

On Sat, Jan 23, 2016 at 03:34:27AM -0200, Marcus Cenzatti wrote: > hello, > > I am testing a chelsio t520-so-cr connected to a Intel card with ix(4) > driver, I can get the ncxl0 interface to transmit at 14Mpps to another > chelsio or to a Intel card. However I can only get 800Kpps-1Mpps for > RX

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

On Sat, Jan 23, 2016 at 11:12:28AM -0800, Luigi Rizzo wrote: > On Sat, Jan 23, 2016 at 10:38 AM, Navdeep Parhar <npar...@gmail.com> wrote: > > On Sat, Jan 23, 2016 at 03:48:39PM -0200, Marcus Cenzatti wrote: > > ... > >> > >> woops, my bad, yes probably we

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

On Sat, Jan 23, 2016 at 09:33:32PM -0800, Luigi Rizzo wrote: > On Sat, Jan 23, 2016 at 8:28 PM, Marcus Cenzatti wrote: > > > > > > On 1/24/2016 at 1:10 AM, "Luigi Rizzo" wrote: > >> > >>Thanks for re-running the experiments. > >> > >>I am changing the

Re: Chelsio cxl and ncxl interface, whats the difference?

On Wed, Jan 20, 2016 at 03:58:18PM +, Teleric Team wrote: > I got a Chelsio T5 520-SO with two ports and I get 2 interfaces for it > port, cxl and ncxl (cxl0 ncxl0 cxl1 ncxl1). Man page mentions cxl is > for T5, what about ncxl? Should I get both or is something wrong? > Which one should I

Re: ethernet header size

sizeof(struct ether_header) On 01/08/2016 15:03, Hadi Rezaee wrote: Hello there, In some part of my application I need to have the Ethernet header size (ideally, using sizeof). Well I guess 'ethhdr' is not exist on FreeBSD, correct ? According to Linux definition: struct ethhdr {

Re: Kernel panics in tcp_twclose

On Wed, Sep 23, 2015 at 11:15:03PM +0200, Palle Girgensohn wrote: ... > > By the way Palle could you also run below Dtrace script to see where > > this tcp_close() in INP_TIMEWAIT comes from: > > > > $ cat tcp-close-tw.d > > fbt::tcp_close:entry > > /args[0]->t_inpcb->inp_flags & 0x0100/ > >

Re: netmap custom RSS and custom packet info

On 06/29/2015 08:17, Slawa Olhovchenkov wrote: ... b) custom RSS. Modern NIC have RSS poorly interoperable with packet analysing: packets from same flow, but different direction placed in different queue, ... This is default behavior because the default hash (Toeplitz) is not symmetrical.

Re: Intel XL710 40GE NIC, i40 driver and wire speed performance with netmap

On Sun, Jun 28, 2015 at 01:18:44PM +0300, Pavel Odintsov wrote: Hello, folks! I'm looking for solution which could do wire speed (56 mpps with 64byte packets) for 40GE. We have tested PF_RING/DPDK on Linux and could not achieve more than ~42 mpps and it's not enough for us. Is this

Re: Frequent hickups on the networking layer

On Wed, Apr 29, 2015 at 01:08:00AM -0400, Garrett Wollman wrote: On Tue, 28 Apr 2015 17:06:02 -0400 (EDT), Rick Macklem rmack...@uoguelph.ca said: ... As far as I know (just from email discussion, never used them myself), you can either stop using jumbo packets or switch to a different net

Re: net.inet.ip.forwarding impact on throughput

On Tue, Apr 21, 2015 at 12:47:45PM -0700, Scott Larson wrote: We're in the process of migrating our network into the future with 40G at the core, including our firewall/traffic routers with 40G interfaces. An issue which this exposed and threw me for a week turns out to be directly

netstat output on a recent head

I see a lot of literal %ns in netstat's output on head. This on a freshly built system from today.. # netstat -hdw 1 input(Total) output packets errs idrops bytespackets errs bytes colls drops %10s 17 %5s 0 %5s 0 %10s 1.3K

[Differential] [Changed Subscribers] D1761: Extend LRO support to accumulate more than 65535 bytes

np added a subscriber: np. np added a reviewer: lstewart. np added a comment. LRO affects the kernel TCP code in subtle (and almost always undesirable) ways by compressing multiple TCP headers into one. Think TCP timestamps, bursty changes in sequence space as seen by the kernel, what happens

Re: cxgbe and netmap

On Fri, Jan 02, 2015 at 06:57:50PM +0300, Alexander V. Chernikov wrote: Hello list! FreeBSD has netmap support for chelsio T5 cards, which is amazing. The great thing about implementation is that you can play with traffic-generating applications without affecting main OS interface, which

Re: OFED support on FreeBSD

On 08/25/14 13:39, David Somayajulu wrote: Hi All, What is the current support for OFED on FreeBSD ? Are there any drivers which support either RoCE or iWARP ? The iw_cxgbe module in sys/dev/cxgbe/iw_cxgbe is an iWARP driver for cxgbe(4) hardware. The upstream version is kernel verbs only,

Re: [RFC] Add support for hardware transmit rate limiting queues [WAS: Add support for changing the flow ID of TCP connections]

On 08/20/14 00:34, Hans Petter Selasky wrote: Hi, A month has passed since the last e-mail on this topic, and in the meanwhile some new patches have been created and tested: Basically the approach has been changed a little bit: - The creation of hardware transmit rings has been made

Re: [RFC] Add support for hardware transmit rate limiting queues [WAS: Add support for changing the flow ID of TCP connections]

On 08/20/14 12:25, Hans Petter Selasky wrote: On 08/20/14 20:44, Navdeep Parhar wrote: On 08/20/14 00:34, Hans Petter Selasky wrote: Hi, A month has passed since the last e-mail on this topic, and in the meanwhile some new patches have been created and tested: Basically the approach has been

Re: [patch][lagg] - Set a better granularity and distribution on roundrobin protocol.

On 07/18/14 00:49, Marcelo Araujo wrote: Hello guys, I made few changes on the lagg(4) patch. Also, I made tests using igb(4), ixgbe(4) and em(4); seems everything worked pretty well. I'm wondering if anyone else could make a review, and what I need to do, to see this patch committed.

Re: [patch][lagg] - Set a better granularity and distribution on roundrobin protocol.

On 07/18/14 19:06, Marcelo Araujo wrote: 2014-07-19 2:18 GMT+08:00 Navdeep Parhar npar...@gmail.com mailto:npar...@gmail.com: On 07/18/14 00:49, Marcelo Araujo wrote: Hello guys, I made few changes on the lagg(4) patch. Also, I made tests using igb(4

Re: change netmap global lock to sx?

On 05/27/14 17:32, Luigi Rizzo wrote: On Wed, May 28, 2014 at 1:49 AM, Navdeep Parhar wrote: I'd like to change the netmap global lock from a mutex into a sleepable shared/exclusive lock. This will allow a driver's nm_register hook (which is called with the global lock

Re: tuning routing using cxgbe and T580-CR cards?

550M15G80 0 0 0 0 6 0 0 73508 179 161498 0 92 8 0 0 0550M15G 0 0 0 0 0 6 0 0 72673 125 159449 0 92 8 0 0 0550M15G80 0 0 0 0 6 0 0 75630 175 164614 0 91 9 On 07/11/2014 03:32 PM, Navdeep Parhar

Re: tuning routing using cxgbe and T580-CR cards?

On Fri, Jul 11, 2014 at 08:58:21PM -0400, John Jasem wrote: On 07/11/2014 03:32 PM, Navdeep Parhar wrote: On 07/11/14 10:28, John Jasem wrote: In testing two Chelsio T580-CR dual port cards with FreeBSD 10-STABLE, I've been able to use a collection of clients to generate approximately

Re: tuning routing using cxgbe and T580-CR cards?

On 07/11/14 11:03, Bjoern A. Zeeb wrote: On 11 Jul 2014, at 17:28 , John Jasem jja...@gmail.com wrote: c) the defaults for the cxgbe driver appear to be 8 rx queues, and N tx queues, with N being the number of CPUs detected. For a system running multiple cards, routing or firewalling, does

Re: tuning routing using cxgbe and T580-CR cards?

On 07/11/14 10:28, John Jasem wrote: In testing two Chelsio T580-CR dual port cards with FreeBSD 10-STABLE, I've been able to use a collection of clients to generate approximately 1.5-1.6 million TCP packets per second sustained, and routinely hit 10GB/s, both measured by netstat -d -b -w1 -W

Re: [RFC] Add support for changing the flow ID of TCP connections

On Wed, Jul 09, 2014 at 04:36:53PM +0200, Hans Petter Selasky wrote: On 07/08/14 21:17, Navdeep Parhar wrote: ... I think we need to design this to be as generic as possible. I have quite a bit of code that does this stuff but I haven't pushed it upstream or even offered it for review (yet

Re: [RFC] Add support for changing the flow ID of TCP connections

On 07/08/14 10:46, Hans Petter Selasky wrote: Hi, I'm working on a new feature which will allow TCP connections to be timing controlled by the ethernet hardware driver, actually the mlxen driver. The main missing piece in the kernel is to allow the mbuf's flowid value to be overwritten in

Re: ifaddr refcount problem

I got distracted by some other issues and lost track of this thread. Can one of you please commit the fix if the discussion has reached a conclusion? Thanks! Regards, Navdeep On Wed, Jun 25, 2014 at 02:08:35PM +0400, Gleb Smirnoff wrote: Alan, On Tue, Jun 24, 2014 at 08:43:40AM -0600,

Re: ifaddr refcount problem

On 06/20/14 15:20, Alan Somers wrote: ... Do you have a test case that can reproduce the panic? -Alan Just run some UDP traffic on head or stable/10 and watch the refcount leak on the transmitter. # netperf -H ... -t UDP_STREAM I see these two do ifa_ref (once per packet).

change netmap global lock to sx?

I'd like to change the netmap global lock from a mutex into a sleepable shared/exclusive lock. This will allow a driver's nm_register hook (which is called with the global lock held) to sleep if it has to. I've casually used pkt-gen after this conversion (patch attached) and the witness hasn't

Re: TCP stack lock contention with short-lived connections

On 05/23/14 13:52, Julien Charbon wrote: Hi, On 23/05/14 14:06, Julien Charbon wrote: On 27/02/14 11:32, Julien Charbon wrote: On 07/11/13 14:55, Julien Charbon wrote: On Mon, 04 Nov 2013 22:21:04 +0100, Julien Charbon jchar...@verisign.com wrote: I have put technical and how-to-repeat

Re: Use of contiguous physical memory in ixgbe driver

On 05/06/14 09:06, Alexander V. Chernikov wrote: Hello guys. (bootstrapping people involved in previous version of this topic, sorry for that) There were several problem descriptions/discussions on using 9k+ mbufs with current allocator in: if_em: kern/183381 cxgbe:

  1   2   >