Hi,
According to my regress statistics kernel crashes reliably since
May 16th. /usr/src/regress/misc/posixtestsuite/ triggers it.
With a witness kernel on amd64:
conformance/interfaces/mlockall/3-6: execution: witness: userret: returning
with the following locks held:
exclusive rwlock vmmaplk r = 0 (0xfffffd886974b6c8)
panic: witness_warn
Stopped at db_enter+0x14: popq %rbp
TID PID UID PRFLAGS PFLAGS CPU COMMAND
*434505 84452 0 0x3 0 1 3-6.test
db_enter() at db_enter+0x14
panic(ffffffff82598df6) at panic+0xdd
witness_warn(2,0,ffffffff8255866e) at witness_warn+0x4c1
userret(ffff80004986ad10) at userret+0x20b
syscall(ffff800049919910) at syscall+0x4e1
Xsyscall() at Xsyscall+0x128
end of kernel
end trace frame: 0x7f4a6c3c5560, count: 9
https://www.openbsd.org/ddb.html describes the minimum info required in bug
reports. Insufficient info makes it difficult to find and fix bugs.
ddb{1}>
ddb{1}> x/s version
version: OpenBSD 7.7-current (GENERIC.MP) #0: Mon May 19 06:27:15 CEST
2025\012
[email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP\012
ddb{1}> show panic
*cpu1: witness_warn
ddb{1}> show locks
exclusive rwlock vmmaplk r = 0 (0xfffffd886974b6c8)
ddb{1}> trace
db_enter() at db_enter+0x14
panic(ffffffff82598df6) at panic+0xdd
witness_warn(2,0,ffffffff8255866e) at witness_warn+0x4c1
userret(ffff80004986ad10) at userret+0x20b
syscall(ffff800049919910) at syscall+0x4e1
Xsyscall() at Xsyscall+0x128
end of kernel
end trace frame: 0x7f4a6c3c5560, count: -6
ddb{1}> show register
rdi 0
rsi 0x10
rbp 0xffff800049919690
rbx 0xfffffd8100673f78
rdx 0xfe00000000000000
rcx 0x282
rax 0x14
r8 0x101010101010101
r9 0
r10 0x5691dc05ecb8eb03
r11 0x371dd12ae53ff845
r12 0xffff8000491d3bd8
r13 0
r14 0
r15 0xffffffff82598df6 apollo_pio_rec+0x4696f
rip 0xffffffff82312984 db_enter+0x14
cs 0x8
rflags 0x202
rsp 0xffff800049919690
ss 0x10
db_enter+0x14: popq %rbp
ddb{1}> ps
PID TID PPID UID S FLAGS WAIT COMMAND
*84452 434505 98369 0 7 0x3 3-6.test
98369 247795 14981 0 3 0x100089 sigsusp sh
14981 465078 81129 0 3 0x10008b sigsusp sh
81129 405462 82819 0 3 0x10008b sigsusp make
17468 81617 55210 0 3 0x100083 ttyin ksh
55210 84024 98886 0 3 0x98 kqread sshd-session
98886 123197 94514 0 3 0x92 kqread sshd-session
82819 395547 1 0 3 0x10008b sigsusp ksh
76447 396975 1 0 3 0x100083 ttyin getty
31039 166128 1 0 3 0x100083 ttyin getty
6493 145286 1 0 3 0x100083 ttyin getty
56195 228045 1 0 3 0x100083 ttyin getty
27191 414554 1 0 3 0x100083 ttyin getty
18453 16649 1 0 3 0x100098 kqread cron
51113 405594 1 99 3 0x1100090 kqread sndiod
93560 436927 1 110 3 0x100090 kqread sndiod
67119 520997 42560 95 3 0x1100092 kqread smtpd
64417 475636 42560 103 3 0x1100092 kqread smtpd
55924 11752 42560 95 3 0x1100092 kqread smtpd
28731 72964 42560 95 3 0x100092 kqread smtpd
64019 339713 42560 95 3 0x1100092 kqread smtpd
75937 228962 42560 95 3 0x1100092 kqread smtpd
42560 308938 1 0 3 0x100080 kqread smtpd
5059 356465 5170 91 3 0x92 kqread snmpd_metrics
86847 140065 5170 91 3 0x1100092 kqread snmpd
5170 331010 1 0 3 0x100080 kqread snmpd
94514 293868 1 0 3 0x88 kqread sshd
74071 268772 0 0 3 0x14200 acct acct
71466 237360 0 0 3 0x14280 nfsidl nfsio
6074 181111 0 0 3 0x14280 nfsidl nfsio
67960 517285 0 0 3 0x14280 nfsidl nfsio
10303 194209 0 0 3 0x14280 nfsidl nfsio
22314 423426 1 0 3 0x100080 kqread ntpd
18632 386620 48806 83 3 0x100092 kqread ntpd
48806 220224 1 83 3 0x1100092 kqread ntpd
99908 33055 23856 74 3 0x1100092 bpf pflogd
23856 393568 1 0 3 0x80 sbwait pflogd
30 110380 92435 73 3 0x1100090 kqread syslogd
92435 74017 1 0 3 0x100082 sbwait syslogd
82381 302521 1 0 3 0x100080 kqread resolvd
3455 406714 31671 77 3 0x100092 kqread dhcpleased
15883 381426 31671 77 3 0x100092 kqread dhcpleased
31671 430467 1 0 3 0x80 kqread dhcpleased
60929 352092 32060 115 3 0x100092 kqread slaacd
84728 14047 32060 115 3 0x100092 kqread slaacd
32060 238266 1 0 3 0x100080 kqread slaacd
83416 458357 0 0 3 0x14200 bored smr
61225 384901 0 0 3 0x14200 pgzero zerothread
69329 477138 0 0 3 0x14200 aiodoned aiodoned
56616 249144 0 0 3 0x14200 syncer update
45465 45156 0 0 3 0x14200 cleaner cleaner
58800 284002 0 0 3 0x14200 reaper reaper
20709 381546 0 0 3 0x14200 pgdaemon pagedaemon
28175 208152 0 0 3 0x14200 bored wsdisplay0
33045 419859 0 0 3 0x14200 mmctsk sdmmc0
70690 402689 0 0 3 0x14200 usbtsk usbtask
32381 295538 0 0 3 0x14200 usbatsk usbatsk
93479 294657 0 0 3 0x40014200 acpi0 acpi0
9704 481015 0 0 7 0x40014200 idle11
82527 68365 0 0 7 0x40014200 idle10
61171 232452 0 0 7 0x40014200 idle9
3443 24119 0 0 7 0x40014200 idle8
26036 151933 0 0 7 0x40014200 idle7
80803 315832 0 0 7 0x40014200 idle6
20776 80232 0 0 7 0x40014200 idle5
68767 511706 0 0 7 0x40014200 idle4
12903 222322 0 0 7 0x40014200 idle3
74535 7828 0 0 7 0x40014200 idle2
32661 453141 0 0 3 0x40014200 idle1
93559 387847 0 0 3 0x14200 bored sensors
49087 459805 0 0 3 0x14200 bored softnet3
14479 53999 0 0 3 0x14200 bored softnet2
62703 10325 0 0 3 0x14200 bored softnet1
74620 200404 0 0 3 0x14200 bored softnet0
70546 476669 0 0 3 0x14200 bored systqmp
22585 397076 0 0 3 0x14200 bored systq
2472 18376 0 0 3 0x14200 tmoslp softclockmp
34209 457318 0 0 3 0x40014200 tmoslp softclock
10567 336211 0 0 7 0x40014200 idle0
1 75927 0 0 3 0x82 wait init
0 0 -1 0 3 0x10200 scheduler swapper
ddb{1}> show uvm
Current UVM status:
pagesize=4096 (0x1000), pagemask=0xfff, pageshift=12
7991816 VM pages: 12334 active, 16054 inactive, 2433 wired, 7701961 free
(963040 zero)
freemin=266393, free-target=355190, inactive-target=0, wired-max=2663938
faults=2475349, traps=2162059, intrs=254596, ctxswitch=832390 fpuswitch=0
softint=444336, syscalls=28991227, kmapent=13
fault counts:
noram=0, noanon=0, noamap=0, pgwait=0, pgrele=0
relocks=44958(1131), upgrades=0(0) anget(retries)=1522359(0),
amapcopy=982395
neighbor anon/obj pg=391611/1193123, gets(lock/unlock)=397059/46092
cases: anon=1244778, anoncow=277581, obj=336099, prcopy=59826, przero=556981
daemon and swap counts:
woke=0, revs=0, scans=0, obscans=0, anscans=0
busy=0, freed=0, reactivate=0, deactivate=0
pageouts=0, pending=0, nswget=0
nswapdev=1
swpages=8391416, swpginuse=0, swpgonly=0 paging=0
kernel pointers:
objs(kern)=0xffffffff82b43650
ddb{0}> trace
x86_ipi_db(ffffffff829fbff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x239
sched_idle(ffffffff829fbff0) at sched_idle+0x288
end trace frame: 0x0, count: -5
ddb{2}> trace
x86_ipi_db(ffff8000491dbff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
clockrequest_advance_random(ffff8000491dcdd8,789680,3fffff) at
clockrequest_advance_random+0x71
statclock(ffff8000491dcdd8,ffff800049777e10,0) at statclock+0x59
clockintr_dispatch(ffff800049777e10) at clockintr_dispatch+0x249
lapic_clockintr(0,0) at lapic_clockintr+0x43
Xresume_lapic_ltimer() at Xresume_lapic_ltimer+0x2a
acpicpu_idle() at acpicpu_idle+0x239
sched_idle(ffff8000491dbff0) at sched_idle+0x288
end trace frame: 0x0, count: -10
ddb{3}> trace
x86_ipi_db(ffff8000491e4ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
random() at random+0x43
clockrequest_advance_random(ffff8000491e5dd8,789680,3fffff) at
clockrequest_advance_random+0x55
statclock(ffff8000491e5dd8,ffff80004977e260,0) at statclock+0x59
clockintr_dispatch(ffff80004977e260) at clockintr_dispatch+0x249
lapic_clockintr(0,0) at lapic_clockintr+0x43
Xresume_lapic_ltimer() at Xresume_lapic_ltimer+0x2a
acpicpu_idle() at acpicpu_idle+0x239
sched_idle(ffff8000491e4ff0) at sched_idle+0x288
end trace frame: 0x0, count: -11
ddb{4}> trace
x86_ipi_db(ffff8000491edff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x239
sched_idle(ffff8000491edff0) at sched_idle+0x288
end trace frame: 0x0, count: -5
ddb{5}> trace
x86_ipi_db(ffff8000491f6ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
statclock(ffff8000491f7dd8,ffff80004978a740,0) at statclock+0x1c5
clockintr_dispatch(ffff80004978a740) at clockintr_dispatch+0x249
lapic_clockintr(0,0) at lapic_clockintr+0x43
Xresume_lapic_ltimer() at Xresume_lapic_ltimer+0x2a
acpicpu_idle() at acpicpu_idle+0x239
sched_idle(ffff8000491f6ff0) at sched_idle+0x288
end trace frame: 0x0, count: -9
ddb{6}> trace
x86_ipi_db(ffff8000491ffff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x239
sched_idle(ffff8000491ffff0) at sched_idle+0x288
end trace frame: 0x0, count: -5
ddb{7}> trace
x86_ipi_db(ffff800049208ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x239
sched_idle(ffff800049208ff0) at sched_idle+0x288
end trace frame: 0x0, count: -5
ddb{8}> trace
x86_ipi_db(ffff800049211ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
microuptime(c34cb23c84253684) at microuptime
sched_idle(ffff800049211ff0) at sched_idle+0x288
end trace frame: 0x0, count: -5
ddb{9}> trace
x86_ipi_db(ffff80004921aff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x239
sched_idle(ffff80004921aff0) at sched_idle+0x288
end trace frame: 0x0, count: -5
ddb{10}> trace
x86_ipi_db(ffff800049223ff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x239
sched_idle(ffff800049223ff0) at sched_idle+0x288
end trace frame: 0x0, count: -5
ddb{11}> trace
x86_ipi_db(ffff80004922cff0) at x86_ipi_db+0x16
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x27
acpicpu_idle() at acpicpu_idle+0x239
sched_idle(ffff80004922cff0) at sched_idle+0x288
end trace frame: 0x0, count: -5
OpenBSD 7.7-current (GENERIC.MP) #0: Mon May 19 06:27:15 CEST 2025
[email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 34102808576 (32522MB)
avail mem = 32725336064 (31209MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 3.2 @ 0x8eb96000 (46 entries)
bios0: vendor American Megatrends Inc. version "L2.41" date 03/22/2022
bios0: genua E3C246D4M-4L
efi0 at bios0: UEFI 2.7
efi0: American Megatrends rev 0x5000d
acpi0 at bios0: ACPI 6.1
acpi0: sleep states S0 S4 S5
acpi0: tables DSDT FACP APIC FPDT FIDT MCFG SPMI SSDT AAFT SSDT HPET SSDT SSDT
UEFI LPIT SSDT SSDT DBGP DBG2 SSDT DMAR SSDT SSDT EINJ ERST BERT HEST WSMT
acpi0: wakeup devices UAR1(S4) RP01(S4) PXSX(S4) RP02(S4) PXSX(S4) RP03(S4)
PXSX(S4) RP04(S4) PXSX(S4) RP05(S4) PXSX(S4) RP06(S4) PXSX(S4) RP07(S4)
PXSX(S4) RP08(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz, 3392.10 MHz, 06-9e-0a, patch
000000fa
cpu0: cpuid 1
edx=bfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
ecx=77fafbff<SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND>
cpu0: cpuid 6 eax=27f7<SENSOR,ARAT> ecx=9<EFFFREQ>
cpu0: cpuid 7.0
ebx=29c6fbb<FSGSBASE,TSC_ADJUST,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT>
edx=bc002e00<SRBDS_CTRL,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD>
cpu0: cpuid a vers=4, gp=4, gpwidth=48, ff=3, ffwidth=48
cpu0: cpuid d.1 eax=f<XSAVEOPT,XSAVEC,XGETBV1,XSAVES>
cpu0: cpuid 80000001 edx=2c100800<NXE,PAGE1GB,RDTSCP,LONG>
ecx=121<LAHF,ABM,3DNOWP>
cpu0: cpuid 80000007 edx=100<ITSC>
cpu0: msr 10a=a000c04<RSBA,MISC_PKG_CT,ENERGY_FILT,GDS_CTRL,RFDS_NO>
cpu0: MELTDOWN
cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB 64b/line
4-way L2 cache, 12MB 64b/line 16-way L3 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 24MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.2.4.1.1.1, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz, 3392.10 MHz, 06-9e-0a, patch
000000fa
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz, 3392.10 MHz, 06-9e-0a, patch
000000fa
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz, 3392.10 MHz, 06-9e-0a, patch
000000fa
cpu3: smt 0, core 3, package 0
cpu4 at mainbus0: apid 8 (application processor)
cpu4: Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz, 3392.10 MHz, 06-9e-0a, patch
000000fa
cpu4: smt 0, core 4, package 0
cpu5 at mainbus0: apid 10 (application processor)
cpu5: Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz, 3392.10 MHz, 06-9e-0a, patch
000000fa
cpu5: smt 0, core 5, package 0
cpu6 at mainbus0: apid 1 (application processor)
cpu6: Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz, 3392.10 MHz, 06-9e-0a, patch
000000fa
cpu6: smt 1, core 0, package 0
cpu7 at mainbus0: apid 3 (application processor)
cpu7: Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz, 3392.10 MHz, 06-9e-0a, patch
000000fa
cpu7: smt 1, core 1, package 0
cpu8 at mainbus0: apid 5 (application processor)
cpu8: Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz, 3392.10 MHz, 06-9e-0a, patch
000000fa
cpu8: smt 1, core 2, package 0
cpu9 at mainbus0: apid 7 (application processor)
cpu9: Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz, 3392.10 MHz, 06-9e-0a, patch
000000fa
cpu9: smt 1, core 3, package 0
cpu10 at mainbus0: apid 9 (application processor)
cpu10: Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz, 3392.10 MHz, 06-9e-0a, patch
000000fa
cpu10: smt 1, core 4, package 0
cpu11 at mainbus0: apid 11 (application processor)
cpu11: Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz, 3392.10 MHz, 06-9e-0a, patch
000000fa
cpu11: smt 1, core 5, package 0
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 120 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0xe0000000, bus 0-255
acpihpet0 at acpi0: 23999999 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus -1 (PEG0)
acpiprt2 at acpi0: bus -1 (PEG1)
acpiprt3 at acpi0: bus -1 (PEG2)
acpiprt4 at acpi0: bus 2 (RP01)
acpiprt5 at acpi0: bus -1 (RP06)
acpiprt6 at acpi0: bus -1 (RP07)
acpiprt7 at acpi0: bus -1 (RP08)
acpiprt8 at acpi0: bus 3 (RP09)
acpiprt9 at acpi0: bus 4 (RP10)
acpiprt10 at acpi0: bus 5 (RP11)
acpiprt11 at acpi0: bus 6 (RP12)
acpiprt12 at acpi0: bus -1 (RP21)
acpiec0 at acpi0: not present
acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
com0 at acpi0 UAR1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at acpi0 UAR2 addr 0x2f8/0x8 irq 3: ns16550a, 16 byte fifo
"IPI0001" at acpi0 not configured
pchgpio0 at acpi0 GPI0 addr 0xfd6e0000/0x10000 0xfd6d0000/0x10000
0xfd6b0000/0x10000 0xfd6a0000/0x10000 irq 14, 384 pins
"ACPI000E" at acpi0 not configured
acpibtn0 at acpi0: SLPB
"PNP0C14" at acpi0 not configured
"PNP0C14" at acpi0 not configured
intelpmc0 at acpi0: PEPD
state 0: 0x7f:1:2:0x00:0x0000000000000060
counter: 0x7f:64:0:0x00:0x0000000000000632
frequency: 0
state 1: 0x7f:1:2:0x00:0x0000000000000060
counter: 0x00:32:0:0x03:0x00000000fe00193c
frequency: 9580
"PNP0C33" at acpi0 not configured
"ACPI000D" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
acpipwrres0 at acpi0: USBC, resource for XDCI
acpipwrres1 at acpi0: V0PR
acpipwrres2 at acpi0: V1PR
acpipwrres3 at acpi0: V2PR
acpipwrres4 at acpi0: WRST
acpicpu0 at acpi0: C3(200@1034 mwait.1@0x60), C2(200@151 mwait.1@0x33),
C1(1000@1 mwait.1), PSS
acpicpu1 at acpi0: C3(200@1034 mwait.1@0x60), C2(200@151 mwait.1@0x33),
C1(1000@1 mwait.1), PSS
acpicpu2 at acpi0: C3(200@1034 mwait.1@0x60), C2(200@151 mwait.1@0x33),
C1(1000@1 mwait.1), PSS
acpicpu3 at acpi0: C3(200@1034 mwait.1@0x60), C2(200@151 mwait.1@0x33),
C1(1000@1 mwait.1), PSS
acpicpu4 at acpi0: C3(200@1034 mwait.1@0x60), C2(200@151 mwait.1@0x33),
C1(1000@1 mwait.1), PSS
acpicpu5 at acpi0: C3(200@1034 mwait.1@0x60), C2(200@151 mwait.1@0x33),
C1(1000@1 mwait.1), PSS
acpicpu6 at acpi0: C3(200@1034 mwait.1@0x60), C2(200@151 mwait.1@0x33),
C1(1000@1 mwait.1), PSS
acpicpu7 at acpi0: C3(200@1034 mwait.1@0x60), C2(200@151 mwait.1@0x33),
C1(1000@1 mwait.1), PSS
acpicpu8 at acpi0: C3(200@1034 mwait.1@0x60), C2(200@151 mwait.1@0x33),
C1(1000@1 mwait.1), PSS
acpicpu9 at acpi0: C3(200@1034 mwait.1@0x60), C2(200@151 mwait.1@0x33),
C1(1000@1 mwait.1), PSS
acpicpu10 at acpi0: C3(200@1034 mwait.1@0x60), C2(200@151 mwait.1@0x33),
C1(1000@1 mwait.1), PSS
acpicpu11 at acpi0: C3(200@1034 mwait.1@0x60), C2(200@151 mwait.1@0x33),
C1(1000@1 mwait.1), PSS
acpipwrres5 at acpi0: FN00, resource for FAN0
acpipwrres6 at acpi0: FN01, resource for FAN1
acpipwrres7 at acpi0: FN02, resource for FAN2
acpipwrres8 at acpi0: FN03, resource for FAN3
acpipwrres9 at acpi0: FN04, resource for FAN4
acpitz0 at acpi0
acpitz0: critical temperature is 119 degC
acpipwrres10 at acpi0: PIN_
acpivideo0 at acpi0: GFX0
acpivout0 at acpivideo0: DD1F
ipmi at mainbus0 not configured
cpu0: using VERW MDS workaround (except on vmm entry)
cpu0: Enhanced SpeedStep 3392 MHz: speeds: 3401, 3400, 3200, 3000, 2800, 2700,
2500, 2300, 2100, 1900, 1700, 1500, 1400, 1200, 1000, 800 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel Core 8G Host" rev 0x07
"Intel Core GMM" rev 0x00 at pci0 dev 8 function 0 not configured
pchtemp0 at pci0 dev 18 function 0 "Intel 300 Series Thermal" rev 0x10
xhci0 at pci0 dev 20 function 0 "Intel 300 Series xHCI" rev 0x10: msi, xHCI 1.10
usb0 at xhci0: USB revision 3.0
uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev 3.00/1.00
addr 1
"Intel 300 Series Shared SRAM" rev 0x10 at pci0 dev 20 function 2 not configured
sdhc0 at pci0 dev 20 function 5 vendor "Intel", unknown product 0xa375 rev
0x10: apic 2 int 19
sdhc0: SDHC 3.00, 200 MHz base clock
sdmmc0 at sdhc0: 4-bit, sd high-speed, mmc high-speed, ddr52, dma
dwiic0 at pci0 dev 21 function 0 "Intel 300 Series I2C" rev 0x10: apic 2 int 16
iic0 at dwiic0
dwiic1 at pci0 dev 21 function 1 "Intel 300 Series I2C" rev 0x10: apic 2 int 17
iic1 at dwiic1
"Intel 300 Series HECI" rev 0x10 at pci0 dev 22 function 0 not configured
"Intel 300 Series HECI" rev 0x10 at pci0 dev 22 function 1 not configured
"Intel 300 Series HECI" rev 0x10 at pci0 dev 22 function 4 not configured
ahci0 at pci0 dev 23 function 0 "Intel 300 Series AHCI" rev 0x10: msi, AHCI
1.3.1
ahci0: port 0: 6.0Gb/s
ahci0: port 1: 6.0Gb/s
ahci0: port 2: 1.5Gb/s
scsibus1 at ahci0: 32 targets
sd0 at scsibus1 targ 0 lun 0: <ATA, SanDisk SSD G5 B, 4150> naa.5001b448b5a37832
sd0: 476940MB, 512 bytes/sector, 976773168 sectors, thin
sd1 at scsibus1 targ 1 lun 0: <ATA, SanDisk SSD G5 B, 4150> naa.5001b448b5a33df4
sd1: 476940MB, 512 bytes/sector, 976773168 sectors, thin
cd0 at scsibus1 targ 2 lun 0: <TEAC, DV-W28SS-B, 1.6A> removable
ppb0 at pci0 dev 27 function 0 "Intel 300 Series PCIE" rev 0xf0
pci1 at ppb0 bus 1
ppb1 at pci0 dev 28 function 0 "Intel 300 Series PCIE" rev 0xf0: msi
pci2 at ppb1 bus 2
ppb2 at pci0 dev 29 function 0 "Intel 300 Series PCIE" rev 0xf0: msi
pci3 at ppb2 bus 3
em0 at pci3 dev 0 function 0 "Intel I210" rev 0x03: msi, address
d0:50:99:f9:d7:0b
ppb3 at pci0 dev 29 function 1 "Intel 300 Series PCIE" rev 0xf0: msi
pci4 at ppb3 bus 4
em1 at pci4 dev 0 function 0 "Intel I210" rev 0x03: msi, address
d0:50:99:f9:d7:0c
ppb4 at pci0 dev 29 function 2 "Intel 300 Series PCIE" rev 0xf0: msi
pci5 at ppb4 bus 5
em2 at pci5 dev 0 function 0 "Intel I210" rev 0x03: msi, address
d0:50:99:f9:d7:0d
ppb5 at pci0 dev 29 function 3 "Intel 300 Series PCIE" rev 0xf0: msi
pci6 at ppb5 bus 6
ppb6 at pci6 dev 0 function 0 "ASPEED Technology AST1150 PCI" rev 0x04
pci7 at ppb6 bus 7
"ASPEED Technology AST2000" rev 0x41 at pci7 dev 0 function 0 not configured
"Intel 300 Series UART" rev 0x10 at pci0 dev 30 function 0 not configured
pcib0 at pci0 dev 31 function 0 "Intel C246 LPC" rev 0x10
ichiic0 at pci0 dev 31 function 4 "Intel 300 Series SMBus" rev 0x10: apic 2 int
16
iic2 at ichiic0
sdtemp0 at iic2 addr 0x19: tse2004gb2
sdtemp1 at iic2 addr 0x1b: tse2004gb2
spdmem0 at iic2 addr 0x51: 16GB DDR4 SDRAM ECC PC4-21300 with thermal sensor
spdmem1 at iic2 addr 0x53: 16GB DDR4 SDRAM ECC PC4-21300 with thermal sensor
"Intel 300 Series SPI" rev 0x10 at pci0 dev 31 function 5 not configured
em3 at pci0 dev 31 function 6 "Intel I219-LM" rev 0x10: msi, address
88:88:88:88:87:88
isa0 at pcib0
isadma0 at isa0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
wbsio0 at isa0 port 0x2e/2: NCT6791D rev 0x03
lm1 at wbsio0 port 0x290/8: NCT6791D
vmm0 at mainbus0: VMX/EPT
efifb0 at mainbus0: 1024x768, 32bpp
wsdisplay0 at efifb0 mux 1
wsdisplay0: screen 0-5 added (std, vt100 emulation)
ugen0 at uhub0 port 3 "Identiv uTrust 2700 R Smart Card Reader" rev 2.00/2.02
addr 2
uftdi0 at uhub0 port 4 configuration 1 interface 0 "FTDI FT232R USB UART" rev
2.00/6.00 addr 3
ucom0 at uftdi0 portno 1: usb0.0.00004.0
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
root on sd0a (6a04a658952b23dd.a) swap on sd0b dump on sd0b
WARNING: / was not properly unmounted
witness: userret: returning with the following locks held:
exclusive rwlock vmmaplk r = 0 (0xfffffd886974b6c8)
I have a i386 machine without witness kernel that crashes at the
same test. I guess it is the same bug.
login: panic: vmmaplk rwlock 0xd61293c0: enter write deadlock
Stopped at db_enter+0x4: popl %ebp
TID PID UID PRFLAGS PFLAGS CPU COMMAND
* 96791 41724 0 0x2 0 0 3-6.test
db_enter() at db_enter+0x4
panic(d0d448c0) at panic+0x7a
rw_do_enter_write(d61293c0,d61293c0) at rw_do_enter_write+0x10c
vm_map_lock_ln(d6129348,d1039060,f6aebf9c) at vm_map_lock_ln+0x82
uvm_map_extract(d6129348,36ec2000,1000,f6aebff0,8) at uvm_map_extract+0x6c
sys_kbind(d6a01844,f6aec090,f6aec088) at sys_kbind+0x2a3
syscall(f6aec0d0) at syscall+0x411
Xsyscall_untramp() at Xsyscall_untramp+0xa9
end of kernel
https://www.openbsd.org/ddb.html describes the minimum info required in bug
reports. Insufficient info makes it difficult to find and fix bugs.
ddb{0}>
ddb{0}> x/s version
version: OpenBSD 7.7-current (GENERIC.MP) #618: Sun May 18 04:25:20 MDT
2025\012
[email protected]:/usr/src/sys/arch/i386/compile/GENERIC.MP\012
ddb{0}> show panic
*cpu0: vmmaplk rwlock 0xd61293c0: enter write deadlock
ddb{0}> trace
db_enter() at db_enter+0x4
panic(d0d448c0) at panic+0x7a
rw_do_enter_write(d61293c0,d61293c0) at rw_do_enter_write+0x10c
vm_map_lock_ln(d6129348,d1039060,f6aebf9c) at vm_map_lock_ln+0x82
uvm_map_extract(d6129348,36ec2000,1000,f6aebff0,8) at uvm_map_extract+0x6c
sys_kbind(d6a01844,f6aec090,f6aec088) at sys_kbind+0x2a3
syscall(f6aec0d0) at syscall+0x411
Xsyscall_untramp() at Xsyscall_untramp+0xa9
end of kernel
ddb{0}> show register
ds 0x10
es 0x10
fs 0x20
gs 0
edi 0xd0d448c0 isapnp_id_to_vendor.hex+0x8fae
esi 0
ebp 0xf6aebf14
ebx 0xd0f2b618 cpu_info_full_primary+0x2618
edx 0x3fd
ecx 0x58e2b9c2
eax 0x37
eip 0xd03b0e04 db_enter+0x4
cs 0x8
eflags 0x202
esp 0xf6aebf14
ss 0x10
db_enter+0x4: popl %ebp
ddb{0}> ps
PID TID PPID UID S FLAGS WAIT COMMAND
*41724 96791 71724 0 7 0x2 3-6.test
71724 394038 53515 0 3 0x100088 sigsusp sh
53515 331563 35347 0 3 0x10008a sigsusp sh
35347 272823 11460 0 3 0x10008a sigsusp make
66741 20437 64648 0 3 0x100083 ttyin ksh
64648 523403 16431 0 3 0x98 kqread sshd-session
16431 166160 45230 0 3 0x92 kqread sshd-session
87616 287766 28843 0 3 0x100082 piperd gzip
28843 498724 11460 0 3 0x100082 piperd pax
11460 193098 75212 0 3 0x82 piperd perl
75212 417809 51318 0 3 0x10008a sigsusp ksh
51318 396878 68461 0 3 0x98 kqread sshd-session
68461 95172 45230 0 3 0x92 kqread sshd-session
4865 275714 1 0 3 0x100083 ttyin getty
57634 523922 1 0 3 0x100083 ttyin getty
66286 329192 1 0 3 0x100083 ttyin getty
80084 343403 1 0 3 0x100083 ttyin getty
97400 411115 1 0 3 0x100083 ttyin getty
98838 69807 1 0 3 0x100083 ttyin getty
82041 108674 1 0 3 0x100098 kqread cron
16060 128005 1 99 3 0x1100090 kqread sndiod
78889 105342 1 110 3 0x100090 kqread sndiod
82006 467896 22672 95 3 0x1100092 kqread smtpd
12674 378124 22672 103 3 0x1100092 kqread smtpd
12438 469484 22672 95 3 0x1100092 kqread smtpd
9467 210591 22672 95 3 0x100092 kqread smtpd
49246 220285 22672 95 3 0x1100092 kqread smtpd
35648 345659 22672 95 3 0x1100092 kqread smtpd
22672 495969 1 0 3 0x100080 kqread smtpd
15637 9574 86077 91 3 0x92 kqread snmpd_metrics
19051 100208 86077 91 3 0x1100092 kqread snmpd
86077 99547 1 0 3 0x100080 kqread snmpd
45230 503069 1 0 3 0x88 kqread sshd
52358 137578 0 0 3 0x14200 acct acct
70416 178424 0 0 3 0x14280 nfsidl nfsio
33843 76562 0 0 3 0x14280 nfsidl nfsio
35053 396184 0 0 3 0x14280 nfsidl nfsio
69279 92380 0 0 3 0x14280 nfsidl nfsio
83396 217657 1 0 3 0x100080 kqread ntpd
86281 99225 92137 83 3 0x100092 kqread ntpd
92137 140985 1 83 3 0x1100092 kqread ntpd
13104 267640 8960 74 3 0x1100092 bpf pflogd
8960 187119 1 0 3 0x80 sbwait pflogd
93045 47117 11333 73 3 0x1100090 kqread syslogd
11333 184635 1 0 3 0x100082 sbwait syslogd
96581 208862 68055 77 3 0x100092 kqread dhcpleased
51992 402565 68055 77 3 0x100092 kqread dhcpleased
68055 78846 1 0 3 0x80 kqread dhcpleased
330 309622 99454 115 3 0x100092 kqread slaacd
80484 406852 99454 115 3 0x100092 kqread slaacd
99454 288639 1 0 3 0x100080 kqread slaacd
80449 113171 0 0 3 0x14200 bored smr
74739 420511 0 0 3 0x14200 pgzero zerothread
2604 293321 0 0 3 0x14200 aiodoned aiodoned
58412 7438 0 0 3 0x14200 syncer update
68065 43482 0 0 3 0x14200 cleaner cleaner
11960 90604 0 0 3 0x14200 reaper reaper
49261 53234 0 0 3 0x14200 pgdaemon pagedaemon
66661 494794 0 0 3 0x14200 bored wsdisplay0
52702 254288 0 0 3 0x14200 usbtsk usbtask
91580 384717 0 0 3 0x14200 usbatsk usbatsk
35405 301982 0 0 3 0x14200 bored sensors
40468 161178 0 0 3 0x40014200 acpi0 acpi0
78842 80430 0 0 7 0x40014200 idle7
66008 296735 0 0 7 0x40014200 idle6
98795 506799 0 0 7 0x40014200 idle5
46750 291519 0 0 7 0x40014200 idle4
93915 264431 0 0 7 0x40014200 idle3
36254 288785 0 0 7 0x40014200 idle2
80599 184748 0 0 7 0x40014200 idle1
46155 255485 0 0 3 0x14200 bored softnet3
4547 393309 0 0 3 0x14200 bored softnet2
77277 468336 0 0 3 0x14200 bored softnet1
84279 64120 0 0 3 0x14200 bored softnet0
37225 326694 0 0 3 0x14200 bored systqmp
48068 338636 0 0 3 0x14200 bored systq
11499 79960 0 0 3 0x14200 tmoslp softclockmp
68952 205978 0 0 3 0x40014200 tmoslp softclock
97668 422802 0 0 3 0x40014200 idle0
38797 250951 0 0 3 0x14200 kmalloc kmthread
1 8125 0 0 3 0x82 wait init
0 0 -1 0 3 0x10200 scheduler swapper
