On 24 June 2014 13:46, Rich <[email protected]> wrote:
> What version of il-gate is it running, then? Latest illumos-gate as of when?
>
> - Rich

OpenIndiana 151a9 pulled illumos-gate 52e13e00baadc11c135170cd60a8b3c4f253a694


It looks like it might be an issue with interrupts.

The same code runnning on another box with a duplicate Intel 82599ES
card works fine.

The obvious differences between the two:

Perfomance Penalty: Dual 8-core (=16 cpus) with an apix interrupt controller.
Performance Great: Dual 4-core with Hyperthreading (=16 cpus) with
pcplusmp interrupt controller.


On the working box (with pcplusmp and 1 intel 82599ES card)

# echo ::interrupts | mdb -k | sed -ne 1p -e /ixgbe/p
IRQ  Vect IPL Bus    Trg Type   CPU Share APIC/INT# ISR(s)
56   0x63 6   PCI    Edg MSI-X  0   1     -         ixgbe_intr_msix
57   0x64 6   PCI    Edg MSI-X  1   1     -         ixgbe_intr_msix
58   0x65 6   PCI    Edg MSI-X  2   1     -         ixgbe_intr_msix
59   0x66 6   PCI    Edg MSI-X  3   1     -         ixgbe_intr_msix

On the slow box (with apix and 2 Intel 82599ES cards + onboard ixgbe)

#  echo ::interrupts | mdb -k | sed -ne 1p -e /ixgbe/p
CPU/Vect  IRQ IPL Bus    Trg Type   Share APIC/INT# ISR
0/0x20    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
0/0x21    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
0/0x22    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
0/0x23    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
0/0x24    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
0/0x25    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
1/0x21    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
1/0x22    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
1/0x23    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
1/0x24    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
1/0x25    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
1/0x26    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
2/0x21    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
2/0x22    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
2/0x23    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
2/0x24    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
2/0x25    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
2/0x26    -   6   PCI    Edg MSI-X  1     -         ixgbe_intr_msix
....
and repeated for CPUs 3-15


-------------------------------------------
illumos-discuss
Archives: https://www.listbox.com/member/archive/182180/=now
RSS Feed: https://www.listbox.com/member/archive/rss/182180/21175430-2e6923be
Modify Your Subscription: 
https://www.listbox.com/member/?member_id=21175430&id_secret=21175430-6a77cda4
Powered by Listbox: http://www.listbox.com

Reply via email to