After upgrading to 7.4, my pine64-lts box failed to boot bsd.mp on two out of two tries, with an identical panic message both times: (see below for full (u-boot + kernel + ddb) boot log of the panic and dmesg from bsd.sp which does boot) -------- panic: uvm_fault: fault on non-pageable map (0xffffff80012dbd48, 0xffffff8007f7 d000) Stopped at panic+0x164: cmp w21, #0x0 TID PID UID PRFLAGS PFLAGS CPU COMMAND 459227 91515 0 0x14000 0x200 3 update *165810 5998 0 0x14000 0x200 2K cleaner 8700 14349 0 0x14000 0x200 1 reaper 0 0 0 0x10000 0x200 0 swapper db_enter() at panic+0x160 panic() at uvm_fault_check+0x5e0 uvm_fault_check() at uvm_fault+0xd4 uvm_fault() at kdata_abort+0xd0 kdata_abort() at handle_el1h_sync+0x6c handle_el1h_sync() at comopen+0x578 comopen() at proc_trampoline+0x4 https://www.openbsd.org/ddb.html describes the minimum info required in bug reports. Insufficient info makes it difficult to find and fix bugs. ddb{2}> trace db_enter() at panic+0x160 panic() at uvm_fault_check+0x5e0 uvm_fault_check() at uvm_fault+0xd4 uvm_fault() at kdata_abort+0xd0 kdata_abort() at handle_el1h_sync+0x6c handle_el1h_sync() at comopen+0x578 comopen() at proc_trampoline+0x4 ddb{2}> machine ddbcpu 0
-------- ddb doesn't come back after I say 'machine ddbcpu 0', it just hung there until I ran out of patience and power cycled (identical behavior in both tries), which makes it impossible to collect traces from the other CPUs as recommended by ddb.html. The only differences between the panic messages are the TID and PID values in the ps listing; the values in the panic message itself and the backtrace match exactly. The upgrade kernel, bsd.rd, and bsd.sp all boot without problems. What other information is worth collecting here? Anything I should try to see if there's a way to fix it without a kernel patch? Thanks, dave serial console log of the full boot + panic with bsd.mp: -------- U-Boot SPL 2021.10 (Apr 09 2022 - 20:52:48 -0600) DRAM: 2048 MiB Trying to boot from MMC2 NOTICE: BL31: v2.5(debug):2.5 NOTICE: BL31: Built : 16:26:47, Apr 9 2022 NOTICE: BL31: Detected Allwinner A64/H64/R18 SoC (1689) NOTICE: BL31: Found U-Boot DTB at 0x4097d10, model: Pine64 LTS INFO: ARM GICv2 driver initialized INFO: Configuring SPC Controller INFO: PMIC: Probing AXP803 on RSB INFO: PMIC: dcdc1 voltage: 3.300V INFO: PMIC: dcdc5 voltage: 1.200V INFO: PMIC: dcdc6 voltage: 1.100V INFO: PMIC: dldo1 voltage: 3.300V INFO: PMIC: dldo2 voltage: 3.300V INFO: PMIC: dldo4 voltage: 3.300V INFO: PMIC: fldo1 voltage: 1.200V INFO: PMIC: Enabling DC SW INFO: BL31: Platform setup done INFO: BL31: Initializing runtime services INFO: BL31: cortex_a53: CPU workaround for 843419 was applied INFO: BL31: cortex_a53: CPU workaround for 855873 was applied INFO: BL31: cortex_a53: CPU workaround for 1530924 was applied INFO: PSCI: Suspend is unavailable INFO: BL31: Preparing for EL3 exit to normal world INFO: Entry point address = 0x4a000000 INFO: SPSR = 0x3c9 U-Boot 2021.10 (Apr 09 2022 - 20:52:48 -0600) Allwinner Technology CPU: Allwinner A64 (SUN50I) Model: Pine64 LTS DRAM: 2 GiB MMC: mmc@1c0f000: 0, mmc@1c11000: 1 Loading Environment from FAT... Unable to read "uboot.env" from mmc1:1... In: serial Out: vidconsole Err: vidconsole Net: phy interface8 eth0: ethernet@1c30000 starting USB... Bus usb@1c1a000: USB EHCI 1.00 Bus usb@1c1a400: USB OHCI 1.0 Bus usb@1c1b000: USB EHCI 1.00 Bus usb@1c1b400: USB OHCI 1.0 scanning bus usb@1c1a000 for devices... 1 USB Device(s) found scanning bus usb@1c1a400 for devices... 1 USB Device(s) found scanning bus usb@1c1b000 for devices... 5 USB Device(s) found scanning bus usb@1c1b400 for devices... 1 USB Device(s) found scanning usb for storage devices... 1 Storage Device(s) found Hit any key to stop autoboot: 2 1 0 switch to partitions #0, OK mmc1(part 0) is current device Scanning mmc 1:1... 28618 bytes read in 3 ms (9.1 MiB/s) 7[r[999;999H[6n8Card did not respond to voltage select! : -110 Scanning disk m...@1c0f000.blk... Disk m...@1c0f000.blk not ready Scanning disk m...@1c11000.blk... Scanning disk usb_mass_storage.lun0... Disk usb_mass_storage.lun0 not ready Found 3 disks No EFI system partition BootOrder not defined EFI boot manager: Cannot load any image Found EFI removable media binary efi/boot/bootaa64.efi 219050 bytes read in 7 ms (29.8 MiB/s) Booting /efi\boot\bootaa64.efi disks: sd0* >> OpenBSD/arm64 BOOTAA64 1.18 |/-\|/-\|/boot> -\|/-\|/-\booting sd0a:/bsd: |/-\|/10659816-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/+2522120-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/+296760-\|/-\|/-\|/-\|/-\+849688| [789483/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/+91+1219896-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\+731575|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|]=0x13b5490 [ using 2741824 bytes of bsd ELF symbol table ] Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. Copyright (c) 1995-2023 OpenBSD. All rights reserved. https://www.OpenBSD.org OpenBSD 7.4 (GENERIC.MP) #2273: Tue Oct 10 09:45:06 MDT 2023 dera...@arm64.openbsd.org:/usr/src/sys/arch/arm64/compile/GENERIC.MP real mem = 2027782144 (1933MB) avail mem = 1928839168 (1839MB) random: good seed from bootblocks mainbus0 at root: Pine64 LTS psci0 at mainbus0: PSCI 1.1, SMCCC 1.2 efi0 at mainbus0: UEFI 2.8 efi0: Das U-Boot rev 0x20211000 smbios0 at efi0: SMBIOS 3.0 smbios0: vendor U-Boot version "2021.10" date 10/01/2021 smbios0: Unknown Unknown Product cpu0 at mainbus0 mpidr 0: ARM Cortex-A53 r0p4 cpu0: 32KB 64b/line 2-way L1 VIPT I-cache, 32KB 64b/line 4-way L1 D-cache cpu0: 512KB 64b/line 16-way L2 cache cpu0: CRC32,SHA2,SHA1,AES+PMULL,ASID16 cpu1 at mainbus0 mpidr 1: ARM Cortex-A53 r0p4 cpu1: 32KB 64b/line 2-way L1 VIPT I-cache, 32KB 64b/line 4-way L1 D-cache cpu1: 512KB 64b/line 16-way L2 cache cpu1: CRC32,SHA2,SHA1,AES+PMULL,ASID16 cpu2 at mainbus0 mpidr 2: ARM Cortex-A53 r0p4 cpu2: 32KB 64b/line 2-way L1 VIPT I-cache, 32KB 64b/line 4-way L1 D-cache cpu2: 512KB 64b/line 16-way L2 cache cpu2: CRC32,SHA2,SHA1,AES+PMULL,ASID16 cpu3 at mainbus0 mpidr 3: ARM Cortex-A53 r0p4 cpu3: 32KB 64b/line 2-way L1 VIPT I-cache, 32KB 64b/line 4-way L1 D-cache cpu3: 512KB 64b/line 16-way L2 cache cpu3: CRC32,SHA2,SHA1,AES+PMULL,ASID16 apm0 at mainbus0 "display-engine" at mainbus0 not configured "osc24M_clk" at mainbus0 not configured "osc32k_clk" at mainbus0 not configured "pmu" at mainbus0 not configured simpleaudio0 at mainbus0 agtimer0 at mainbus0: 24000 kHz simplebus0 at mainbus0: "soc" sxisyscon0 at simplebus0 sxisid0 at simplebus0 sxiccmu0 at simplebus0 sxipio0 at simplebus0: 103 pins ampintc0 at simplebus0 nirq 224, ncpu 4 ipi: 0, 1, 2: "interrupt-controller" sxirtc0 at simplebus0 sxiccmu1 at simplebus0 sxipio1 at simplebus0: 13 pins sxirsb0 at simplebus0 axppmic0 at sxirsb0 addr 0x3a3: AXP803 "bus" at simplebus0 not configured "dma-controller" at simplebus0 not configured "lcd-controller" at simplebus0 not configured "lcd-controller" at simplebus0 not configured "video-codec" at simplebus0 not configured sximmc0 at simplebus0 sdmmc0 at sximmc0: 4-bit, sd high-speed, mmc high-speed, dma sximmc1 at simplebus0 sdmmc1 at sximmc1: 8-bit, sd high-speed, mmc high-speed, dma "crypto" at simplebus0 not configured "mailbox" at simplebus0 not configured "usb" at simplebus0 not configured "phy" at simplebus0 not configured ehci0 at simplebus0 usb0 at ehci0: USB revision 2.0 uhub0 at usb0 configuration 1 interface 0 "Generic EHCI root hub" rev 2.00/1.00 addr 1 ohci0 at simplebus0: version 1.0 ehci1 at simplebus0 usb1 at ehci1: USB revision 2.0 uhub1 at usb1 configuration 1 interface 0 "Generic EHCI root hub" rev 2.00/1.00 addr 1 ohci1 at simplebus0: version 1.0 "timer" at simplebus0 not configured sxidog0 at simplebus0 "dai" at simplebus0 not configured "codec" at simplebus0 not configured sxitemp0 at simplebus0 com0 at simplebus0: dw16550 com0: console "spi" at simplebus0 not configured dwxe0 at simplebus0: address 02:bc:b8:a1:ec:e9 rgephy0 at dwxe0 phy 1: RTL8169S/8110S/8211 PHY, rev. 5 "gpu" at simplebus0 not configured "dram-controller" at simplebus0 not configured "deinterlace" at simplebus0 not configured "hdmi" at simplebus0 not configured "hdmi-phy" at simplebus0 not configured sxirintc0 at simplebus0 "codec-analog" at simplebus0 not configured gpio0 at sxipio0: 32 pins gpio1 at sxipio0: 32 pins gpio2 at sxipio0: 32 pins gpio3 at sxipio0: 32 pins gpio4 at sxipio0: 32 pins gpio5 at sxipio0: 32 pins gpio6 at sxipio0: 32 pins gpio7 at sxipio0: 32 pins gpio8 at sxipio1: 32 pins usb2 at ohci0: USB revision 1.0 uhub2 at usb2 configuration 1 interface 0 "Generic OHCI root hub" rev 1.00/1.00 addr 1 usb3 at ohci1: USB revision 1.0 uhub3 at usb3 configuration 1 interface 0 "Generic OHCI root hub" rev 1.00/1.00 addr 1 "opp_table0" at mainbus0 not configured "hdmi-connector" at mainbus0 not configured "vcc1v8" at mainbus0 not configured gpioleds0 at mainbus0: no LEDs simplefb0 at mainbus0: 1920x1080, 32bpp wsdisplay0 at simplefb0 mux 1 wsdisplay0: screen 0-5 added (std, vt100 emulation) sdmmc0: can't enable card scsibus0 at sdmmc1: 2 targets, initiator 0 sd0 at scsibus0 targ 1 lun 0: <SD/MMC, NCard, 0000> removable sd0: 59000MB, 512 bytes/sector, 120832000 sectors uhub4 at uhub1 port 1 configuration 1 interface 0 "VIA Labs, Inc. USB2.0 Hub" rev 2.10/2.14 addr 2 umass0 at uhub4 port 1 configuration 1 interface 0 "ASMT ASMT105x" rev 2.10/1.00 addr 3 umass0: using SCSI over Bulk-Only scsibus1 at umass0: 2 targets, initiator 0 sd1 at scsibus1 targ 1 lun 0: <WDC WD40, EFAX-68JH4N1, 0> serial.174c55aa234567890126 sd1: 3815447MB, 512 bytes/sector, 7814037168 sectors uhidev0 at uhub4 port 2 configuration 1 interface 0 "Unicomp Endura Pro Keyboard" rev 1.10/43.34 addr 4 uhidev0: iclass 3/1 ukbd0 at uhidev0: 8 variable keys, 6 key codes wskbd0 at ukbd0 mux 1 wskbd0: connecting to wsdisplay0 uhidev1 at uhub4 port 2 configuration 1 interface 1 "Unicomp Endura Pro Keyboard" rev 1.10/43.34 addr 4 uhidev1: iclass 3/1, 3 report ids ums0 at uhidev1 reportid 1: 3 buttons, Z dir wsmouse0 at ums0 mux 0 ucc0 at uhidev1 reportid 2: 573 usages, 20 keys, array wskbd1 at ucc0 mux 1 wskbd1: connecting to wsdisplay0 uhid0 at uhidev1 reportid 3: input=1, output=0, feature=0 uhidev2 at uhub4 port 3 configuration 1 interface 0 "Logitech USB Laser Mouse" rev 2.00/56.01 addr 5 uhidev2: iclass 3/1 ums1 at uhidev2: 8 buttons, Z and W dir wsmouse1 at ums1 mux 0 vscsi0 at root scsibus2 at vscsi0: 256 targets softraid0 at root scsibus3 at softraid0: 256 targets root on sd0a (823130ad660d9ca0.a) swap on sd0b dump on sd0b panic: uvm_fault: fault on non-pageable map (0xffffff80012dbd48, 0xffffff8007f7 d000) Stopped at panic+0x164: cmp w21, #0x0 TID PID UID PRFLAGS PFLAGS CPU COMMAND 459227 91515 0 0x14000 0x200 3 update *165810 5998 0 0x14000 0x200 2K cleaner 8700 14349 0 0x14000 0x200 1 reaper 0 0 0 0x10000 0x200 0 swapper db_enter() at panic+0x160 panic() at uvm_fault_check+0x5e0 uvm_fault_check() at uvm_fault+0xd4 uvm_fault() at kdata_abort+0xd0 kdata_abort() at handle_el1h_sync+0x6c handle_el1h_sync() at comopen+0x578 comopen() at proc_trampoline+0x4 https://www.openbsd.org/ddb.html describes the minimum info required in bug reports. Insufficient info makes it difficult to find and fix bugs. ddb{2}> trace db_enter() at panic+0x160 panic() at uvm_fault_check+0x5e0 uvm_fault_check() at uvm_fault+0xd4 uvm_fault() at kdata_abort+0xd0 kdata_abort() at handle_el1h_sync+0x6c handle_el1h_sync() at comopen+0x578 comopen() at proc_trampoline+0x4 ddb{2}> machine ddbcpu 0 -------- bsd.sp dmesg: -------- OpenBSD 7.4 (GENERIC) #321: Tue Oct 10 09:15:09 MDT 2023 dera...@arm64.openbsd.org:/usr/src/sys/arch/arm64/compile/GENERIC real mem = 2027782144 (1933MB) avail mem = 1928851456 (1839MB) random: boothowto does not indicate good seed mainbus0 at root: Pine64 LTS psci0 at mainbus0: PSCI 1.1, SMCCC 1.2 efi0 at mainbus0: UEFI 2.8 efi0: Das U-Boot rev 0x20211000 smbios0 at efi0: SMBIOS 3.0 smbios0: vendor U-Boot version "2021.10" date 10/01/2021 smbios0: Unknown Unknown Product cpu0 at mainbus0 mpidr 0: ARM Cortex-A53 r0p4 cpu0: 32KB 64b/line 2-way L1 VIPT I-cache, 32KB 64b/line 4-way L1 D-cache cpu0: 512KB 64b/line 16-way L2 cache cpu0: CRC32,SHA2,SHA1,AES+PMULL,ASID16 apm0 at mainbus0 "display-engine" at mainbus0 not configured "osc24M_clk" at mainbus0 not configured "osc32k_clk" at mainbus0 not configured "pmu" at mainbus0 not configured simpleaudio0 at mainbus0 agtimer0 at mainbus0: 24000 kHz simplebus0 at mainbus0: "soc" sxisyscon0 at simplebus0 sxisid0 at simplebus0 sxiccmu0 at simplebus0 sxipio0 at simplebus0: 103 pins ampintc0 at simplebus0 nirq 224, ncpu 4: "interrupt-controller" sxirtc0 at simplebus0 sxiccmu1 at simplebus0 sxipio1 at simplebus0: 13 pins sxirsb0 at simplebus0 axppmic0 at sxirsb0 addr 0x3a3: AXP803 "bus" at simplebus0 not configured "dma-controller" at simplebus0 not configured "lcd-controller" at simplebus0 not configured "lcd-controller" at simplebus0 not configured "video-codec" at simplebus0 not configured sximmc0 at simplebus0 sdmmc0 at sximmc0: 4-bit, sd high-speed, mmc high-speed, dma sximmc1 at simplebus0 sdmmc1 at sximmc1: 8-bit, sd high-speed, mmc high-speed, dma "crypto" at simplebus0 not configured "mailbox" at simplebus0 not configured "usb" at simplebus0 not configured "phy" at simplebus0 not configured ehci0 at simplebus0 usb0 at ehci0: USB revision 2.0 uhub0 at usb0 configuration 1 interface 0 "Generic EHCI root hub" rev 2.00/1.00 addr 1 ohci0 at simplebus0: version 1.0 ehci1 at simplebus0 usb1 at ehci1: USB revision 2.0 uhub1 at usb1 configuration 1 interface 0 "Generic EHCI root hub" rev 2.00/1.00 addr 1 ohci1 at simplebus0: version 1.0 "timer" at simplebus0 not configured sxidog0 at simplebus0 "dai" at simplebus0 not configured "codec" at simplebus0 not configured sxitemp0 at simplebus0 com0 at simplebus0: dw16550 com0: console "spi" at simplebus0 not configured dwxe0 at simplebus0: address 02:bc:b8:a1:ec:e9 rgephy0 at dwxe0 phy 1: RTL8169S/8110S/8211 PHY, rev. 5 "gpu" at simplebus0 not configured "dram-controller" at simplebus0 not configured "deinterlace" at simplebus0 not configured "hdmi" at simplebus0 not configured "hdmi-phy" at simplebus0 not configured sxirintc0 at simplebus0 "codec-analog" at simplebus0 not configured gpio0 at sxipio0: 32 pins gpio1 at sxipio0: 32 pins gpio2 at sxipio0: 32 pins gpio3 at sxipio0: 32 pins gpio4 at sxipio0: 32 pins gpio5 at sxipio0: 32 pins gpio6 at sxipio0: 32 pins gpio7 at sxipio0: 32 pins gpio8 at sxipio1: 32 pins usb2 at ohci0: USB revision 1.0 uhub2 at usb2 configuration 1 interface 0 "Generic OHCI root hub" rev 1.00/1.00 addr 1 usb3 at ohci1: USB revision 1.0 uhub3 at usb3 configuration 1 interface 0 "Generic OHCI root hub" rev 1.00/1.00 addr 1 "opp_table0" at mainbus0 not configured "hdmi-connector" at mainbus0 not configured "vcc1v8" at mainbus0 not configured gpioleds0 at mainbus0: no LEDs simplefb0 at mainbus0: 1920x1080, 32bpp wsdisplay0 at simplefb0 mux 1 wsdisplay0: screen 0-5 added (std, vt100 emulation) sdmmc0: can't enable card scsibus0 at sdmmc1: 2 targets, initiator 0 sd0 at scsibus0 targ 1 lun 0: <SD/MMC, NCard, 0000> removable sd0: 59000MB, 512 bytes/sector, 120832000 sectors uhub4 at uhub1 port 1 configuration 1 interface 0 "VIA Labs, Inc. USB2.0 Hub" rev 2.10/2.14 addr 2 umass0 at uhub4 port 1 configuration 1 interface 0 "ASMT ASMT105x" rev 2.10/1.00 addr 3 umass0: using SCSI over Bulk-Only scsibus1 at umass0: 2 targets, initiator 0 sd1 at scsibus1 targ 1 lun 0: <WDC WD40, EFAX-68JH4N1, 0> serial.174c55aa234567890126 sd1: 3815447MB, 512 bytes/sector, 7814037168 sectors uhidev0 at uhub4 port 2 configuration 1 interface 0 "Unicomp Endura Pro Keyboard" rev 1.10/43.34 addr 4 uhidev0: iclass 3/1 ukbd0 at uhidev0: 8 variable keys, 6 key codes wskbd0 at ukbd0 mux 1 wskbd0: connecting to wsdisplay0 uhidev1 at uhub4 port 2 configuration 1 interface 1 "Unicomp Endura Pro Keyboard" rev 1.10/43.34 addr 4 uhidev1: iclass 3/1, 3 report ids ums0 at uhidev1 reportid 1: 3 buttons, Z dir wsmouse0 at ums0 mux 0 ucc0 at uhidev1 reportid 2: 573 usages, 20 keys, array wskbd1 at ucc0 mux 1 wskbd1: connecting to wsdisplay0 uhid0 at uhidev1 reportid 3: input=1, output=0, feature=0 uhidev2 at uhub4 port 3 configuration 1 interface 0 "Logitech USB Laser Mouse" rev 2.00/56.01 addr 5 uhidev2: iclass 3/1 ums1 at uhidev2: 8 buttons, Z and W dir wsmouse1 at ums1 mux 0 vscsi0 at root scsibus2 at vscsi0: 256 targets softraid0 at root scsibus3 at softraid0: 256 targets root on sd0a (823130ad660d9ca0.a) swap on sd0b dump on sd0b -------- -- Dave Vandervies dj3va...@terse.ca Plan your future! Make God laugh!