On 2026/10/31 14:16, Stuart Henderson wrote: > I've just had similar issues with a quad "Intel X710 SFP+ rev 0x02, > FW 7.0.50775 API 1.8, msix, 4 queues" though all queues stalled not > just some (with OACTIVE in flags). I was using baby jumbos / jumbos > (1800/8000). > > Have now updated if_ixl.c to r1.119 and removed jumbos from the > config and immediate problem resolved, let's see how things go.
...and hit it again with jumbos removed. <gr0-thn:~>$ ifconfig ixl|grep OACT ixl1: flags=4008c43<UP,BROADCAST,RUNNING,OACTIVE,SIMPLEX,MULTICAST> mtu 1500 ixl2: flags=4008c43<UP,BROADCAST,RUNNING,OACTIVE,SIMPLEX,MULTICAST> mtu 1500 ixl3: flags=4008c43<UP,BROADCAST,RUNNING,OACTIVE,SIMPLEX,MULTICAST> mtu 1500 <gr0-thn:~>$ ifconfig ixl|grep mtu.*80 <gr0-thn:~>$ doas -s doas ([email protected]) password: <gr0-thn:/home/sthen># ifconfig ixl1 down ifconfig: ixl1: SIOCSIFFLAGS: Operation timed out <gr0-thn:/home/sthen># for i in 0 1 2 3; do kstat ixl$i::: | tee kstat.ixl$i ; done < ixl0:0:ixl-port:0 rx bytes: 252660242 bytes mac local errs: 0 mac remote errs: 0 mac short: 0 packets crc errs: 0 packets rx len errs: 0 packets byte errs: 0 packets illegal byte: 0 packets rx undersize: 0 packets rx oversize: 0 packets rx link xon: 0 packets rx link xoff: 0 packets rx 64B: 0 packets rx 65-127B: 2559629 packets rx 128-255B: 46513 packets rx 256-511B: 1055 packets rx 512-1023B: 256 packets rx 1024-1522B: 152 packets rx 1523-9522B: 0 packets rx fragment: 0 packets rx jabber: 0 packets rx ucasts: 2557243 packets rx mcasts: 50261 packets rx bcasts: 101 packets rx discards: 0 packets rx lo discards: 0 packets rx no dest: 2607605 packets tx bytes: 9932966664 bytes tx 64B: 407005 packets tx 65-127B: 1816221 packets tx 128-255B: 2039486 packets tx 256-511B: 1033356 packets tx 512-1023B: 321837 packets tx 1024-1522B: 6197085 packets tx 1523-9522B: 0 packets tx link xon: 0 packets tx link xoff: 0 packets tx ucasts: 11768453 packets tx mcasts: 46486 packets tx bcasts: 51 packets tx link down: 0 packets ixl0:0:ixl-vsi:0 rx discards: 282 packets tx bytes: 9884863740 bytes tx ucasts: 11768453 packets tx mcasts: 46486 packets tx bcasts: 51 packets tx errs: 0 packets tx discards: 0 packets rx bytes: 252644438 bytes rx ucasts: 2557243 packets rx mcasts: 50071 packets rx bcasts: 101 packets rx noproto: 0 packets ixl0:0:rxq:0 packets: 808196 packets bytes: 65873875 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 778246 dequeues: 739931 ixl0:0:rxq:1 packets: 845402 packets bytes: 81672228 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 838090 dequeues: 829468 ixl0:0:rxq:2 packets: 649170 packets bytes: 61003217 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 647116 dequeues: 638570 ixl0:0:rxq:3 packets: 304361 packets bytes: 23210282 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 301111 dequeues: 293666 ixl0:0:txq:0 packets: 3363449 packets bytes: 2042948789 bytes qdrops: 0 packets errors: 0 packets qlen: 0 packets maxqlen: 1024 packets oactive: false oactives: 0 ixl0:0:txq:1 packets: 3759803 packets bytes: 3202558945 bytes qdrops: 0 packets errors: 0 packets qlen: 0 packets maxqlen: 1024 packets oactive: false oactives: 0 ixl0:0:txq:2 packets: 2442940 packets bytes: 1930372546 bytes qdrops: 0 packets errors: 0 packets qlen: 0 packets maxqlen: 1024 packets oactive: false oactives: 0 ixl0:0:txq:3 packets: 2250111 packets bytes: 2661876870 bytes qdrops: 0 packets errors: 0 packets qlen: 0 packets maxqlen: 1024 packets oactive: false oactives: 74 ixl1:0:ixl-port:0 rx bytes: 36439139126 bytes mac local errs: 0 mac remote errs: 0 mac short: 0 packets crc errs: 0 packets rx len errs: 0 packets byte errs: 0 packets illegal byte: 0 packets rx undersize: 0 packets rx oversize: 0 packets rx link xon: 0 packets rx link xoff: 0 packets rx 64B: 6462369 packets rx 65-127B: 55739939 packets rx 128-255B: 3325482 packets rx 256-511B: 1480798 packets rx 512-1023B: 1275516 packets rx 1024-1522B: 20083683 packets rx 1523-9522B: 0 packets rx fragment: 0 packets rx jabber: 0 packets rx ucasts: 88145948 packets rx mcasts: 144510 packets rx bcasts: 77329 packets rx discards: 0 packets rx lo discards: 0 packets rx no dest: 88367787 packets tx bytes: 11312427692 bytes tx 64B: 2044223 packets tx 65-127B: 8567010 packets tx 128-255B: 6921681 packets tx 256-511B: 3708540 packets tx 512-1023B: 846805 packets tx 1024-1522B: 5169218 packets tx 1523-9522B: 0 packets tx link xon: 0 packets tx link xoff: 0 packets tx ucasts: 27127954 packets tx mcasts: 92010 packets tx bcasts: 37513 packets tx link down: 0 packets ixl1:0:ixl-vsi:0 rx discards: 953 packets tx bytes: 11198833293 bytes tx ucasts: 27127954 packets tx mcasts: 92010 packets tx bcasts: 37513 packets tx errs: 0 packets tx discards: 0 packets rx bytes: 36439126386 bytes rx ucasts: 88145948 packets rx mcasts: 144378 packets rx bcasts: 77329 packets rx noproto: 0 packets ixl1:0:rxq:0 packets: 13348652 packets bytes: 6611409504 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 8234347 dequeues: 6566707 ixl1:0:rxq:1 packets: 12792476 packets bytes: 4619820559 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 8987562 dequeues: 8490675 ixl1:0:rxq:2 packets: 18103874 packets bytes: 9480295712 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 10460892 dequeues: 9199982 ixl1:0:rxq:3 packets: 44121608 packets bytes: 15047404323 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 26702098 dequeues: 18333153 ixl1:0:txq:0 packets: 6302344 packets bytes: 3826506180 bytes qdrops: 3687 packets errors: 0 packets qlen: 1024 packets maxqlen: 1024 packets oactive: true oactives: 1 ixl1:0:txq:1 packets: 7732465 packets bytes: 2720307423 bytes qdrops: 3422 packets errors: 0 packets qlen: 1024 packets maxqlen: 1024 packets oactive: true oactives: 1 ixl1:0:txq:2 packets: 4479677 packets bytes: 1824481482 bytes qdrops: 360 packets errors: 0 packets qlen: 1024 packets maxqlen: 1024 packets oactive: true oactives: 1 ixl1:0:txq:3 packets: 8729071 packets bytes: 2720396494 bytes qdrops: 213 packets errors: 0 packets qlen: 1024 packets maxqlen: 1024 packets oactive: true oactives: 1 ixl2:0:ixl-port:0 rx bytes: 50954844569 bytes mac local errs: 1 mac remote errs: 2 mac short: 0 packets crc errs: 0 packets rx len errs: 0 packets byte errs: 0 packets illegal byte: 0 packets rx undersize: 0 packets rx oversize: 0 packets rx link xon: 0 packets rx link xoff: 0 packets rx 64B: 10161980 packets rx 65-127B: 36070677 packets rx 128-255B: 896286 packets rx 256-511B: 523632 packets rx 512-1023B: 460375 packets rx 1024-1522B: 31908827 packets rx 1523-9522B: 0 packets rx fragment: 0 packets rx jabber: 0 packets rx ucasts: 50731905 packets rx mcasts: 23985762 packets rx bcasts: 5304110 packets rx discards: 0 packets rx lo discards: 0 packets rx no dest: 80021777 packets tx bytes: 72301658160 bytes tx 64B: 7451214 packets tx 65-127B: 77377389 packets tx 128-255B: 18833304 packets tx 256-511B: 3711706 packets tx 512-1023B: 1778125 packets tx 1024-1522B: 40768752 packets tx 1523-9522B: 0 packets tx link xon: 0 packets tx link xoff: 0 packets tx ucasts: 149793879 packets tx mcasts: 123349 packets tx bcasts: 3262 packets tx link down: 0 packets ixl2:0:ixl-vsi:0 rx discards: 8236 packets tx bytes: 71659265567 bytes tx ucasts: 149793879 packets tx mcasts: 123349 packets tx bcasts: 3262 packets tx errs: 0 packets tx discards: 0 packets rx bytes: 48801575799 bytes rx ucasts: 50731633 packets rx mcasts: 64487 packets rx bcasts: 5304110 packets rx noproto: 0 packets ixl2:0:rxq:0 packets: 10449606 packets bytes: 9387495757 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 4740875 dequeues: 4023770 ixl2:0:rxq:1 packets: 7631273 packets bytes: 5436497104 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 4145534 dequeues: 4002994 ixl2:0:rxq:2 packets: 13571579 packets bytes: 5918598933 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 9905581 dequeues: 9119216 ixl2:0:rxq:3 packets: 24438619 packets bytes: 27816998952 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 6624388 dequeues: 5758985 ixl2:0:txq:0 packets: 29657859 packets bytes: 12575033302 bytes qdrops: 26917 packets errors: 0 packets qlen: 1024 packets maxqlen: 1024 packets oactive: true oactives: 1 ixl2:0:txq:1 packets: 15747904 packets bytes: 5832519566 bytes qdrops: 2389 packets errors: 0 packets qlen: 1024 packets maxqlen: 1024 packets oactive: true oactives: 1 ixl2:0:txq:2 packets: 29842082 packets bytes: 15035022876 bytes qdrops: 5400 packets errors: 0 packets qlen: 1024 packets maxqlen: 1024 packets oactive: true oactives: 1 ixl2:0:txq:3 packets: 74684212 packets bytes: 38210384890 bytes qdrops: 2470 packets errors: 0 packets qlen: 1024 packets maxqlen: 1024 packets oactive: true oactives: 1 ixl3:0:ixl-port:0 rx bytes: 195349599 bytes mac local errs: 0 mac remote errs: 0 mac short: 0 packets crc errs: 0 packets rx len errs: 0 packets byte errs: 0 packets illegal byte: 0 packets rx undersize: 0 packets rx oversize: 0 packets rx link xon: 0 packets rx link xoff: 0 packets rx 64B: 9227 packets rx 65-127B: 84215 packets rx 128-255B: 41447 packets rx 256-511B: 84130 packets rx 512-1023B: 94245 packets rx 1024-1522B: 56324 packets rx 1523-9522B: 0 packets rx fragment: 0 packets rx jabber: 0 packets rx ucasts: 369519 packets rx mcasts: 63 packets rx bcasts: 6 packets rx discards: 0 packets rx lo discards: 0 packets rx no dest: 369588 packets tx bytes: 193404971 bytes tx 64B: 97639 packets tx 65-127B: 1283120 packets tx 128-255B: 72906 packets tx 256-511B: 10848 packets tx 512-1023B: 17422 packets tx 1024-1522B: 39882 packets tx 1523-9522B: 0 packets tx link xon: 0 packets tx link xoff: 0 packets tx ucasts: 1521713 packets tx mcasts: 5 packets tx bcasts: 99 packets tx link down: 0 packets ixl3:0:ixl-vsi:0 rx discards: 0 packets tx bytes: 186716230 bytes tx ucasts: 1521713 packets tx mcasts: 5 packets tx bcasts: 99 packets tx errs: 0 packets tx discards: 0 packets rx bytes: 195349435 bytes rx ucasts: 369519 packets rx mcasts: 61 packets rx bcasts: 6 packets rx noproto: 0 packets ixl3:0:rxq:0 packets: 182720 packets bytes: 91632747 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 170002 dequeues: 162737 ixl3:0:rxq:1 packets: 160728 packets bytes: 100178012 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 151434 dequeues: 148665 ixl3:0:rxq:2 packets: 15973 packets bytes: 1279076 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 15953 dequeues: 15896 ixl3:0:rxq:3 packets: 10159 packets bytes: 780896 bytes fdrops: 0 packets qdrops: 0 packets errors: 0 packets qlen: 0 packets enqueues: 10142 dequeues: 10090 ixl3:0:txq:0 packets: 1320643 packets bytes: 147064162 bytes qdrops: 0 packets errors: 0 packets qlen: 736 packets maxqlen: 1024 packets oactive: true oactives: 1 ixl3:0:txq:1 packets: 140094 packets bytes: 15596571 bytes qdrops: 0 packets errors: 0 packets qlen: 0 packets maxqlen: 1024 packets oactive: false oactives: 0 ixl3:0:txq:2 packets: 47402 packets bytes: 22501068 bytes qdrops: 0 packets errors: 0 packets qlen: 0 packets maxqlen: 1024 packets oactive: false oactives: 0 ixl3:0:txq:3 packets: 17210 packets bytes: 2323273 bytes qdrops: 0 packets errors: 0 packets qlen: 0 packets maxqlen: 1024 packets oactive: false oactives: 0 <gr0-thn:/home/sthen># ifconfig|grep OAC ixl1: flags=4008c43<UP,BROADCAST,RUNNING,OACTIVE,SIMPLEX,MULTICAST> mtu 1500 ixl2: flags=4008c43<UP,BROADCAST,RUNNING,OACTIVE,SIMPLEX,MULTICAST> mtu 1500 ixl3: flags=4008c43<UP,BROADCAST,RUNNING,OACTIVE,SIMPLEX,MULTICAST> mtu 1500 <gr0-thn:/home/sthen># /sbin/reboot- syncing disks... done ixl0: failed to shut down ringsixl1: failed to shut down ringsixl2: failed to shut down ringsixl3: failed to shut down ringsrebooting...
