On Tue, Jun 10, 2025 at 11:43:10AM +0200, Tim Kuijsten wrote:
> > Synopsis: kernel panic while building userland
> > Category: system kernel amd64
> > Environment:
> System : OpenBSD 7.7
> Details : OpenBSD 7.7-current (GENERIC.MP) #708: Mon Jun 9 20:52:14
> MDT 2025
>
> [email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
>
> Architecture: OpenBSD.amd64
> Machine : amd64
> > Description:
> kernel panic while building userland in a tmux session
> > How-To-Repeat:
> run `make build -j4` in a tmux session
> > Fix:
> so far only OpenBSD 7.6 seems to be stable
>
> Related: https://marc.info/?l=openbsd-bugs&m=174860986624388&w=2
>
> ddb{1}> show panic
> *cpu1: pool_cache_item_magic_check: pvpl cpu free list modified: item addr
> 0xff
> fffd83e07f39c8+24 0xffb5964604070453!=0xffb596c604070453
This is a single bit flip (0x4 vs 0xc). Are you sure that this is not bad
HW (e.g. bad memory)?
> ddb{1}> trace
> db_enter() at db_enter+0x14
> panic(ffffffff82547673) at panic+0xdd
> pool_cache_get(ffffffff82b1e0a8) at pool_cache_get+0x28a
> pool_get(ffffffff82b1e0a8,2) at pool_get+0x62
> pmap_enter(fffffd83cddb4608,26d2a4d8000,479550000,3,22) at pmap_enter+0xc0
> uvm_fault_lower(ffff800048c0d428,ffff800048c0d460,ffff800048c0d3a0) at
> uvm_faul
> t_lower+0x27c
> uvm_fault(fffffd83901975a8,26d2a4d8000,0,2) at uvm_fault+0x1c5
> upageflttrap(ffff800048c0d590,26d2a4d8b70) at upageflttrap+0x6c
> usertrap(ffff800048c0d590) at usertrap+0x217
> recall_trap() at recall_trap+0x8
> end of kernel
> end trace frame: 0x73fd1e232fb0, count: -10
> ddb{1}> ps
> PID TID PPID UID S FLAGS WAIT COMMAND
> *54949 54186 58773 0 7 0x3 miniperl
> 58773 379556 89394 0 3 0x10008b sigsusp sh
> 89394 377419 68151 0 3 0x10008b sigsusp make
> 68151 17104 52449 0 3 0x83 wait miniperl
> 88438 170233 2224 1000 3 0x100083 kqread top
> 52449 57608 93580 0 3 0x10008b sigsusp sh
> 93580 471873 93875 0 3 0x10008b sigsusp make
> 93875 457671 82132 0 3 0x10008b sigsusp sh
> 82132 482702 4461 0 3 0x10008b sigsusp make
> 4461 522354 48629 0 3 0x10008b sigsusp sh
> 48629 403729 93120 0 3 0x10008b sigsusp make
> 93120 96400 36305 0 3 0x10008b sigsusp sh
> 36305 514776 8546 0 3 0x10008b sigsusp make
> 8546 238367 4692 0 3 0x10008b sigsusp sh
> 4692 489660 26944 0 3 0x10008b sigsusp make
> 26944 436341 48257 0 3 0x10008b sigsusp sh
> 48257 314396 10008 0 3 0x10008b sigsusp make
> 10008 435666 92084 0 3 0x10008b sigsusp ksh
> 12176 217804 1 535 3 0x90 nanoslp symon
> 91118 143402 85218 1000 3 0x100083 ttyin less
> 85218 32061 56713 1000 3 0x100083 wait man
> 2224 468397 33721 1000 3 0x10008b sigsusp ksh
> 92084 61154 33721 1000 3 0x10008b sigsusp ksh
> 44638 23896 33721 1000 3 0x100083 ttyin ksh
> 56713 172890 33721 1000 3 0x10008b sigsusp ksh
> 45369 407637 33721 1000 3 0x100083 ttyin ksh
> 33721 465132 1 1000 7 0x100000 tmux
> 8101 517017 88882 1000 3 0x100083 kqread tmux
> 88882 142952 16959 1000 3 0x10008b sigsusp ksh
> 16959 450958 19368 1000 3 0x98 kqread sshd-session
> 19368 298213 50108 0 3 0x92 kqread sshd-session
> 23309 95592 1 0 3 0x100083 ttyin getty
> 82503 389144 1 0 3 0x100083 ttyin getty
> 62647 227725 1 0 3 0x100083 ttyin getty
> 67173 236152 1 0 3 0x100083 ttyin getty
> 1995 482306 1 0 3 0x100083 ttyin getty
> 81825 183167 1 0 3 0x100083 ttyin getty
> 35746 309914 1 0 3 0x100098 kqread cron
> 85538 503030 1 99 3 0x1100090 kqread sndiod
> 41770 301621 1 110 3 0x100090 kqread sndiod
> 52659 113445 9460 95 3 0x1100092 kqread smtpd
> 84871 4209 9460 103 3 0x1100092 kqread smtpd
> 46725 297071 9460 95 3 0x1100092 kqread smtpd
> 35638 47706 9460 95 3 0x100092 kqread smtpd
> 3360 461965 9460 95 3 0x1100092 kqread smtpd
> 39214 299935 9460 95 3 0x1100092 kqread smtpd
> 9460 32231 1 0 3 0x100080 kqread smtpd
> 50108 473143 1 0 3 0x88 kqread sshd
> 49911 398998 1 0 3 0x100080 kqread ntpd
> 84795 239602 61042 83 3 0x100092 kqread ntpd
> 61042 125560 1 83 3 0x1100092 kqread ntpd
> 64801 344510 24162 74 3 0x1100092 bpf pflogd
> 24162 227361 1 0 3 0x80 sbwait pflogd
> 59846 185408 13198 73 3 0x1100090 kqread syslogd
> 13198 113275 1 0 3 0x100082 sbwait syslogd
> 55019 246978 1 0 3 0x100080 kqread resolvd
> 26130 10064 83350 77 3 0x100092 kqread dhcpleased
> 65979 299139 83350 77 3 0x100092 kqread dhcpleased
> 83350 165614 1 0 3 0x80 kqread dhcpleased
> 33193 435463 249 115 3 0x100092 kqread slaacd
> 23231 235380 249 115 3 0x100092 kqread slaacd
> 249 389535 1 0 3 0x100080 kqread slaacd
> 19173 429356 0 0 3 0x14200 bored wsdisplay0
> 74229 370575 0 0 3 0x14200 bored drm_dp_mst_wq
> 61134 429512 0 0 3 0x14200 bored drm_dp_mst_wq
> 83280 269401 0 0 3 0x14200 bored drm_dp_mst_wq
> 58320 264147 0 0 3 0x14200 bored i915_flip
> 65794 357044 0 0 3 0x14200 bored i915_modeset
> 13591 212683 0 0 3 0x14200 bored card0-crtc2
> 38863 424144 0 0 3 0x14200 bored card0-crtc1
> 1715 69990 0 0 3 0x14200 bored card0-crtc0
> 27880 105033 0 0 3 0x14200 bored ttm
> 92120 294135 0 0 3 0x14200 bored i915-unordered
> 10863 318237 0 0 3 0x14200 bored i915-dp
> 42648 327288 0 0 3 0x14200 bored i915
> 48711 115390 0 0 3 0x14200 bored smr
> 25743 89568 0 0 3 0x14200 pgzero zerothread
> 59568 357224 0 0 3 0x14200 aiodoned aiodoned
> 61293 370319 0 0 3 0x14200 syncer update
> 68589 145868 0 0 3 0x14200 cleaner cleaner
> 38839 82981 0 0 3 0x14200 reaper reaper
> 18794 380707 0 0 3 0x14200 pgdaemon pagedaemon
> 49918 491489 0 0 3 0x14200 mmctsk sdmmc0
> 98998 145422 0 0 3 0x14200 usbtsk usbtask
> 20272 164520 0 0 3 0x14200 usbatsk usbatsk
> 72677 365328 0 0 3 0x14200 bored drmtskl
> 89596 105410 0 0 3 0x14200 bored drmlwq
> 7943 158806 0 0 3 0x14200 bored drmlwq
> 23687 336616 0 0 3 0x14200 bored drmlwq
> 74020 84079 0 0 3 0x14200 bored drmlwq
> 30112 482723 0 0 3 0x14200 bored drmubwq
> 43191 326547 0 0 3 0x14200 bored drmubwq
> 34018 98690 0 0 3 0x14200 bored drmubwq
> 91067 291089 0 0 3 0x14200 bored drmubwq
> 31045 53920 0 0 3 0x14200 bored drmhpwq
> 45040 239782 0 0 3 0x14200 bored drmhpwq
> 72943 307284 0 0 3 0x14200 bored drmhpwq
> 95367 196853 0 0 3 0x14200 bored drmhpwq
> 89330 83856 0 0 3 0x14200 bored drmwq
> 75745 267234 0 0 3 0x14200 bored drmwq
> 56522 309431 0 0 3 0x14200 bored drmwq
> 93614 297251 0 0 3 0x14200 bored drmwq
> 98839 276590 0 0 3 0x40014200 acpi0 acpi0
> 24381 138326 0 0 3 0x40014200 idle3
> 30225 520432 0 0 7 0x40014200 idle2
> 44511 321109 0 0 3 0x40014200 idle1
> 33001 422903 0 0 3 0x14200 bored sensors
> 4207 7696 0 0 3 0x14200 bored softnet3
> 89839 457051 0 0 3 0x14200 bored softnet2
> 84812 518415 0 0 3 0x14200 bored softnet1
> 17082 228503 0 0 3 0x14200 bored softnet0
> 39579 145246 0 0 3 0x14200 bored systqmp
> 8553 161614 0 0 3 0x14200 bored systq
> 61077 200705 0 0 3 0x14200 tmoslp softclockmp
> 95001 264079 0 0 3 0x40014200 tmoslp softclock
> 9091 112029 0 0 7 0x40014200 idle0
> 1 133931 0 0 3 0x82 wait init
> 0 0 -1 0 3 0x10200 scheduler swapper
> ddb{1}> show registers
> rdi 0xa
> rsi 0x14
> rbp 0xffff800048c0d000
> rbx 0xfffffd847f167080
> rdx 0xc000000000000000
> rcx 0x206
> rax 0x88
> r8 0x101010101010101
> r9 0
> r10 0xfd5ce01bea09a093
> r11 0x3d6ec8ecb86c1db2
> r12 0xffff800036843bb0
> r13 0x26d2a4d8000
> r14 0
> r15 0xffffffff82547673 packet_length+0x5093
> rip 0xffffffff81a7fe14 db_enter+0x14
> cs 0x8
> rflags 0x206
> rsp 0xffff800048c0d000
> ss 0
> db_enter+0x14: popq %rbp
>
> dmesg:
> OpenBSD 7.7-current (GENERIC.MP) #708: Mon Jun 9 20:52:14 MDT 2025
> [email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> real mem = 16973451264 (16187MB)
> avail mem = 16432336896 (15671MB)
> random: good seed from bootblocks
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 3.3 @ 0x76134000 (18 entries)
> bios0: vendor 3mdeb version "Dasharo (coreboot+UEFI) v0.9.0" date 04/30/2025
> bios0: Protectli VP2430
> efi0 at bios0: UEFI 2.8
> efi0: EDK II rev 0x10000
> acpi0 at bios0: ACPI 6.0
> acpi0: sleep states S0 S3 S4 S5
> acpi0: tables DSDT FACP SSDT MCFG TPM2 LPIT APIC SPCR DMAR HPET
> acpi0: wakeup devices XHCI(S3) GLAN(S4) TXHC(S4) PXSX(S4) PXSX(S4) PXSX(S4)
> PXSX(S4)
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpimcfg0 at acpi0
> acpimcfg0: addr 0xc0000000, bus 0-255
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> ioapic0 at mainbus0: apid 0 pa 0xfec00000, version 20, 120 pins
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: Intel(R) N150, 2893.33 MHz, 06-be-00, patch 0000001d
> cpu0: cpuid 1
> edx=bfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
>
> ecx=77fafbff<SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND>
> cpu0: cpuid 6 eax=578ff7<SENSOR,ARAT> ecx=9<EFFFREQ>
> cpu0: cpuid 7.0
> ebx=239ca7eb<FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,RDSEED,ADX,SMAP,CLFLUSHOPT,CLWB,PT,SHA>
> ecx=98c007ac<UMIP,PKU,WAITPKG,PKS>
> edx=fc184410<MD_CLEAR,IBT,IBRS,IBPB,STIBP,L1DF,SSBD>
> cpu0: cpuid a vers=5, gp=6, gpwidth=48, ff=3, ffwidth=48
> cpu0: cpuid d.1 eax=f<XSAVEOPT,XSAVEC,XGETBV1,XSAVES>
> cpu0: cpuid 80000001 edx=2c100800<NXE,PAGE1GB,RDTSCP,LONG>
> ecx=121<LAHF,ABM,3DNOWP>
> cpu0: cpuid 80000007 edx=100<ITSC>
> cpu0: msr
> 10a=15c0fd6b<IBRS_ALL,SKIP_L1DFL,MDS_NO,IF_PSCHANGE,TAA_NO,MISC_PKG_CT,ENERGY_FILT,DOITM,SBDR_SSDP_N,FBSDP_NO,PSDP_NO,OVERCLOCK,PBRSB_NO,GDS_NO,RFDS_CLEAR>
> cpu0: 32KB 64b/line 8-way D-cache, 64KB 64b/line 8-way I-cache, 2MB 64b/line
> 16-way L2 cache, 6MB 64b/line 12-way L3 cache
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
> cpu0: apic clock running at 38MHz
> cpu0: mwait min=64, max=64, C-substates=0.2.0.2.0.1.0.1, IBE
> cpu1 at mainbus0: apid 2 (application processor)
> cpu1: Intel(R) N150, 2893.33 MHz, 06-be-00, patch 0000001d
> cpu1: smt 0, core 1, package 0
> cpu2 at mainbus0: apid 4 (application processor)
> cpu2: Intel(R) N150, 2893.33 MHz, 06-be-00, patch 0000001d
> cpu2: smt 0, core 2, package 0
> cpu3 at mainbus0: apid 6 (application processor)
> cpu3: Intel(R) N150, 2893.33 MHz, 06-be-00, patch 0000001d
> cpu3: smt 0, core 3, package 0
> acpihpet0 at acpi0: 19200000 Hz
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus 1 (RP01)
> acpiprt2 at acpi0: bus -1 (RP02)
> acpiprt3 at acpi0: bus 2 (RP03)
> acpiprt4 at acpi0: bus 3 (RP04)
> acpiprt5 at acpi0: bus -1 (RP05)
> acpiprt6 at acpi0: bus -1 (RP06)
> acpiprt7 at acpi0: bus 4 (RP07)
> acpiprt8 at acpi0: bus -1 (RP08)
> acpiprt9 at acpi0: bus 5 (RP09)
> acpiprt10 at acpi0: bus -1 (RP10)
> acpiprt11 at acpi0: bus -1 (RP11)
> acpiprt12 at acpi0: bus -1 (RP12)
> acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
> pchgpio0 at acpi0 GPIO addr 0xfd6e0000/0x10000 0xfd6d0000/0x10000
> 0xfd6a0000/0x10000 0xfd690000/0x10000 irq 14, 384 pins
> acpicmos0 at acpi0
> "PNP0A05" at acpi0 not configured
> com0 at acpi0 SER1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo
> com0: console
> com1 at acpi0 SER2 addr 0x2f8/0x8 irq 3: ns16550a, 16 byte fifo
> "INT3515" at acpi0 not configured
> "INTC1079" at acpi0 not configured
> "INTC1026" at acpi0 not configured
> "INTC105C" at acpi0 not configured
> intelpmc0 at acpi0: PEPD
> state 0: 0x7f:1:2:0x00:0x0000000000000060
> counter: 0x7f:64:0:0x00:0x0000000000000632
> frequency: 0
> state 1: 0x7f:1:2:0x00:0x0000000000000060
> counter: 0x00:32:0:0x03:0x00000000fe00193c
> frequency: 0
> acpicpu0 at acpi0: C3(200@260 mwait.1@0x40), C2(350@127 mwait.1@0x21),
> C1(1000@1 mwait.1), PSS
> acpicpu1 at acpi0: C3(200@260 mwait.1@0x40), C2(350@127 mwait.1@0x21),
> C1(1000@1 mwait.1), PSS
> acpicpu2 at acpi0: C3(200@260 mwait.1@0x40), C2(350@127 mwait.1@0x21),
> C1(1000@1 mwait.1), PSS
> acpicpu3 at acpi0: C3(200@260 mwait.1@0x40), C2(350@127 mwait.1@0x21),
> C1(1000@1 mwait.1), PSS
> "BOOT0000" at acpi0 not configured
> cpu0: using VERW MDS workaround
> cpu0: Enhanced SpeedStep 2893 MHz: speeds: 801, 800, 700 MHz
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "Intel N100 Host" rev 0x00
> inteldrm0 at pci0 dev 2 function 0 "Intel Graphics" rev 0x00
> drm0 at inteldrm0
> inteldrm0: msi, ALDERLAKE_P, gen 12
> xhci0 at pci0 dev 13 function 0 "Intel ADL-N xHCI" rev 0x00: msi, xHCI 1.20
> usb0 at xhci0: USB revision 3.0
> uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev
> 3.00/1.00 addr 1
> xhci1 at pci0 dev 20 function 0 "Intel ADL-N xHCI" rev 0x00: msi, xHCI 1.20
> usb1 at xhci1: USB revision 3.0
> uhub1 at usb1 configuration 1 interface 0 "Intel xHCI root hub" rev
> 3.00/1.00 addr 1
> "Intel ADL-N SRAM" rev 0x00 at pci0 dev 20 function 2 not configured
> dwiic0 at pci0 dev 21 function 0 "Intel ADL-N I2C" rev 0x00: apic 0 int 37
> iic0 at dwiic0
> ahci0 at pci0 dev 23 function 0 "Intel ADL-N AHCI" rev 0x00: msi, AHCI 1.3.1
> ahci0: PHY offline on port 0
> scsibus1 at ahci0: 32 targets
> dwiic1 at pci0 dev 25 function 0 "Intel ADL-N I2C" rev 0x00: apic 0 int 41
> iic1 at dwiic1
> "INT3515" at iic1 addr 0x27 not configured
> sdhc0 at pci0 dev 26 function 0 "Intel ADL-N eMMC" rev 0x00: apic 0 int 23
> sdhc0: SDHC 3.00, 200 MHz base clock
> sdmmc0 at sdhc0: 8-bit, sd high-speed, mmc high-speed, ddr52, dma
> ppb0 at pci0 dev 28 function 0 "Intel ADL-N PCIE" rev 0x00: msi
> pci1 at ppb0 bus 1
> igc0 at pci1 dev 0 function 0 "Intel I226-V" rev 0x04, msix, 4 queues,
> address 64:62:66:23:b9:a3
> ppb1 at pci0 dev 28 function 2 "Intel ADL-N PCIE" rev 0x00: msi
> pci2 at ppb1 bus 2
> igc1 at pci2 dev 0 function 0 "Intel I226-V" rev 0x04, msix, 4 queues,
> address 64:62:66:23:b9:a4
> ppb2 at pci0 dev 28 function 3 "Intel ADL-N PCIE" rev 0x00: msi
> pci3 at ppb2 bus 3
> igc2 at pci3 dev 0 function 0 "Intel I226-V" rev 0x04, msix, 4 queues,
> address 64:62:66:23:b9:a5
> ppb3 at pci0 dev 28 function 6 "Intel ADL-N PCIE" rev 0x00: msi
> pci4 at ppb3 bus 4
> igc3 at pci4 dev 0 function 0 "Intel I226-V" rev 0x04, msix, 4 queues,
> address 64:62:66:23:b9:a6
> ppb4 at pci0 dev 29 function 0 "Intel ADL-N PCIE" rev 0x00: msi
> pci5 at ppb4 bus 5
> nvme0 at pci5 dev 0 function 0 vendor "Kingston", unknown product 0x5028 rev
> 0x03: msix, NVMe 1.4
> nvme0: KINGSTON SNV3S500G, firmware SDQ00103, serial 50026B7785D44D4F
> scsibus2 at nvme0: 2 targets, initiator 0
> sd0 at scsibus2 targ 1 lun 0: <NVMe, KINGSTON SNV3S50, SDQ0>
> sd0: 476940MB, 512 bytes/sector, 976773168 sectors
> pcib0 at pci0 dev 31 function 0 "Intel ADL-N eSPI" rev 0x00
> azalia0 at pci0 dev 31 function 3 "Intel ADL-N HD Audio" rev 0x00: msi
> azalia0: no HD-Audio codecs
> ichiic0 at pci0 dev 31 function 4 "Intel ADL-N SMBus" rev 0x00: apic 0 int
> 20
> iic2 at ichiic0
> iic2: addr 0x48 15=2c 16=20 19=04 1b=05 1c=60 1e=60 1f=60 20=89 21=78 22=63
> 25=78 26=63 27=78 28=63 29=90 2a=9a 2b=42 2c=20 2d=22 2e=04 2f=5a 32=80
> 34=0e 3b=12 3c=8a 3d=8c words 00=0000 01=0000 02=0000 03=0000 04=0000
> 05=0000 06=0000 07=0000
> "eeprom" at iic2 addr 0x50 not configured
> "Intel ADL-N SPI" rev 0x00 at pci0 dev 31 function 5 not configured
> isa0 at pcib0
> isadma0 at isa0
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> vmm0 at mainbus0: VMX/EPT
> efifb at mainbus0 not configured
> sdmmc0: can't re-read EXT_CSD
> sdmmc0: mem init failed
> scsibus3 at sdmmc0: 2 targets, initiator 0
> sd1 at scsibus3 targ 1 lun 0: <Samsung, BJTD4R, 0000> removable
> sd1: 1024MB, 512 bytes/sector, 2097152 sectors
> vscsi0 at root
> scsibus4 at vscsi0: 256 targets
> softraid0 at root
> scsibus5 at softraid0: 256 targets
> root on sd0a (a7ad2b2a188c8680.a) swap on sd0b dump on sd0b
> WARNING: / was not properly unmounted
> inteldrm0: 1024x768, 32bpp
> wsdisplay0 at inteldrm0 mux 1
> wsdisplay0: screen 0-5 added (std, vt100 emulation)
>
> usbdevs:
> Controller /dev/usb0:
> addr 01: 8086:0000 Intel, xHCI root hub
> super speed, self powered, config 1, rev 1.00
> driver: uhub0
> Controller /dev/usb1:
> addr 01: 8086:0000 Intel, xHCI root hub
> super speed, self powered, config 1, rev 1.00
> driver: uhub1
>
--
:wq Claudio
