On 17.6.2020. 13:13, Jonathan Matthew wrote: > On Wed, Jun 17, 2020 at 12:50:46PM +0200, Hrvoje Popovski wrote: >> On 17.6.2020. 12:45, Hrvoje Popovski wrote: >>> On 17.6.2020. 11:27, Hrvoje Popovski wrote: >>>> On 17.6.2020. 10:36, David Gwynne wrote: >>>>> this is an updated version of a diff from christiano haesbaert by way of >>>>> mpi@ to enable the use of multiple tx and rx rings with msi-x. >>>>> >>>>> the high level description is that that driver checks to see if msix is >>>>> available, and if so how many vectors it has. it then gets an intrmap >>>>> based on that information, and bumps the number of queues to the number >>>>> of cpus that intrmap says are available. >>>>> >>>>> once the queues are allocated, it then iterates over them and wires up >>>>> interrupts to the cpus provided by the intrmap. >>>>> >>>>> im happy for people to try this out, but i can't commit it until all the >>>>> architectures that ix(4) is enabled on support the APIs that it's using. >>>>> this basically means it'll work on amd64 (and a little bit on i386), but >>>>> not much else. please hold back your tears and cries of anguish. >>>>> >>>>> thanks to christiano and mpi for doing most of the work leading up to >>>>> this diff :) >>>> >>>> Hi, >>>> >>>> first, thank you all for mq work :) >>>> >>>> with this diff, if i'm sending traffic over ix and at the same time >>>> execute ifconfig ix down/up, forwarding stops until i stop generator, >>>> wait for few seconds and execute ifconfig ix down/up few times and than >>>> forwarding start normally >>> >> >> >> in vmstat i should see ix0:0-5 and ix1:0-5 ? > > vmstat -i only shows interrupts that have actually fired. Use -zi to show > all interrupts. > > This diff doesn't set up RSS, so received packets will only go to the first > vector, which is why only one of the ix1 interrupts has fired. Outgoing > packets are scattered across the tx queues, so all the ix0 interrupts have > fired.
yes, thank you .. r620-1# vmstat -iz interrupt total rate irq0/clock 4967987 599 irq0/ipi 14405128 1738 irq144/acpi0 4 0 irq114/ix0:0 20722297 2501 irq115/ix0:1 15585680 1881 irq116/ix0:2 14654922 1768 irq117/ix0:3 861769301 104015 irq118/ix0:4 17121128 2066 irq119/ix0:5 17010524 2053 irq120/ix0 10 0 irq121/ix1:0 55895380 6746 irq122/ix1:1 0 0 irq123/ix1:2 0 0 irq124/ix1:3 0 0 irq125/ix1:4 0 0 irq126/ix1:5 0 0 irq127/ix1 16 0 irq96/ppb1 0 0 irq97/mfi0 38092 4 irq98/ppb3 0 0 irq128/ixl0 0 0 irq129/ixl0:0 0 0 irq130/ixl1 0 0 irq131/ixl1:0 0 0 irq132/ixl2 7 0 irq133/ixl2:0 565 0 irq134/ixl3 7 0 irq135/ixl3:0 559 0 irq99/ehci0 139 0 irq136/em0 23087 2 irq137/em1 559 0 irq100/ehci1 28 0 irq101/ahci0 1 0 irq145/com0 0 0 irq146/com1 4411 0 Total 1022199832 123379
