ixgbe/ix sysctl missing in FreeBSD 9.2

2013-10-03 Thread Rumen Telbizov
Hello everyone, I am trying to tweak some of the sysctl tunables for the ix (ixgbe) driver in FreeBSD 9.2 since I am experiencing less than ideal performance and it seems like I can't find any: # sysctl -a | grep -i ixgbe deviceixgbe I am running 9.2-RC4. Any input appreciated. Thanks, --

Re: ixgbe/ix sysctl missing in FreeBSD 9.2

2013-10-03 Thread Jack Vogel
sysctl dev.ix.0 etc... Jack On Thu, Oct 3, 2013 at 12:35 PM, Rumen Telbizov telbi...@gmail.com wrote: Hello everyone, I am trying to tweak some of the sysctl tunables for the ix (ixgbe) driver in FreeBSD 9.2 since I am experiencing less than ideal performance and it seems like I can't

Re: ixgbe/ix sysctl missing in FreeBSD 9.2

2013-10-03 Thread Rumen Telbizov
Thanks Jack, So I am running a couple of FreeBSD machines with those and they are in LACP pair plus vlans on top of them. When I run iperf between the two I get about about 1.7Gbit/s with 1 thread and I max out around 4.5-5Gbp/s with 6-8 multiple parallel threads (tried both UDP and TCP). What

Re: ixgbe/ix sysctl missing in FreeBSD 9.2

2013-10-03 Thread Jack Vogel
Make sure you are in slots with enough lanes/bandwidth, the driver should complain when loaded if you aren't though. Make sure you aren't getting interrupts throttled, and that you have sufficient mbuf resources so you aren't waiting on those, that can make a BIG difference. Jack On Thu, Oct

Re: ixgbe/ix sysctl missing in FreeBSD 9.2

2013-10-03 Thread Rumen Telbizov
Jack, Thanks for the hints. I checked that the card is inserted into PCIe v3.0 x16 + I get no complaints from the driver. I checked for interrupt throttling messages in the logs - found nothing. I also set hw.intr_storm_threshold: 1 then I saw hw.igb.max_interrupt_rate: 8000 and figured that

Re: ixgbe/ix sysctl missing in FreeBSD 9.2

2013-10-03 Thread Jack Vogel
Set the storm threshold to 0, that way you disable the check and don't have to wonder if its a problem :) Given everything you've told me I'd suspect the switch... easy enough to test, remove it from the equation, run two systems back-to-back and see how that effects the numbers. Jack On Thu,

Re: ixgbe/ix sysctl missing in FreeBSD 9.2

2013-10-03 Thread Rumen Telbizov
Thanks Jack, The switch/lacp is where I was shifting my focus to. Unfortunately it's a remote site and it'll take some time before I can take it out of the picture so I figured I might ask you first ;) I'll report back here when I have more information. Thanks for your feedback. Highly

Re: ixgbe/ix sysctl missing in FreeBSD 9.2

2013-10-03 Thread Adrian Chadd
There's an LACP knob that ignores doing the LACP hash if the mbuf has a flowid. Find that knob and set it to 0. Then, retry. -a On 3 October 2013 15:24, Rumen Telbizov telbi...@gmail.com wrote: Jack, Thanks for the hints. I checked that the card is inserted into PCIe v3.0 x16 + I get no