On Tue, Jun 24, 2014 at 03:46:03PM +1000, Kris Shannon via illumos-discuss wrote: > On 24 June 2014 13:46, Rich <[email protected]> wrote: > > What version of il-gate is it running, then? Latest illumos-gate as of when? > > > > - Rich > > OpenIndiana 151a9 pulled illumos-gate 52e13e00baadc11c135170cd60a8b3c4f253a694 > > > It looks like it might be an issue with interrupts. > > The same code runnning on another box with a duplicate Intel 82599ES > card works fine. > > The obvious differences between the two: > > Perfomance Penalty: Dual 8-core (=16 cpus) with an apix interrupt controller. > Performance Great: Dual 4-core with Hyperthreading (=16 cpus) with > pcplusmp interrupt controller. > > > On the working box (with pcplusmp and 1 intel 82599ES card) > > # echo ::interrupts | mdb -k | sed -ne 1p -e /ixgbe/p > IRQ Vect IPL Bus Trg Type CPU Share APIC/INT# ISR(s) > 56 0x63 6 PCI Edg MSI-X 0 1 - ixgbe_intr_msix > 57 0x64 6 PCI Edg MSI-X 1 1 - ixgbe_intr_msix > 58 0x65 6 PCI Edg MSI-X 2 1 - ixgbe_intr_msix > 59 0x66 6 PCI Edg MSI-X 3 1 - ixgbe_intr_msix > > On the slow box (with apix and 2 Intel 82599ES cards + onboard ixgbe)
Does it speed up if you disable apix? (/etc/system: set apix_enable = 0) Jeff. > # echo ::interrupts | mdb -k | sed -ne 1p -e /ixgbe/p > CPU/Vect IRQ IPL Bus Trg Type Share APIC/INT# ISR > 0/0x20 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 0/0x21 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 0/0x22 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 0/0x23 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 0/0x24 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 0/0x25 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 1/0x21 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 1/0x22 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 1/0x23 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 1/0x24 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 1/0x25 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 1/0x26 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 2/0x21 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 2/0x22 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 2/0x23 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 2/0x24 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 2/0x25 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > 2/0x26 - 6 PCI Edg MSI-X 1 - ixgbe_intr_msix > .... > and repeated for CPUs 3-15 > > > ------------------------------------------- > illumos-discuss > Archives: https://www.listbox.com/member/archive/182180/=now > RSS Feed: https://www.listbox.com/member/archive/rss/182180/22618840-a024d06b > Modify Your Subscription: https://www.listbox.com/member/?&; > Powered by Listbox: http://www.listbox.com -- The box said "Windows XP or better required". So I installed Linux. ------------------------------------------- illumos-discuss Archives: https://www.listbox.com/member/archive/182180/=now RSS Feed: https://www.listbox.com/member/archive/rss/182180/21175430-2e6923be Modify Your Subscription: https://www.listbox.com/member/?member_id=21175430&id_secret=21175430-6a77cda4 Powered by Listbox: http://www.listbox.com
