On 7.2.2023. 17:02, Hrvoje Popovski wrote:
> Hi all,
>
> In lab I'm playing around with ip4/ip6 sasyncd setup which requires
> carp, pf, pfsync, isakmpd, sasyncd.
> I'm sending ip4/ip6 traffic though ipsec tunnels and at the same time
> sending ip4 traffic over firewall just to activate all cores. I'm having
> NET_TASKQ=6 on 6 cores firewalls.
>
> ix2 is pfsync interface and when sending traffic and doing ifconfig ix2
> down && ifconfig ix2 up from time to time I'm able to trigger panic.
>
> this panic is with WITNESS and when doing mach ddbcpu X box freeze
Hi,
this panic is with plain snapshot and I didn't do anything. I will leave
box in ddb if something else is needed.
ddb{0}> dmesg
OpenBSD 7.2-current (GENERIC.MP) #1021: Sun Feb 5 09:52:50 MST 2023
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
r620-2# uvm_fault(0xffffffff824fb2f8, 0x14e, 0, 1) -> e
kernel: page fault trap, code=0
Stopped at pfsync_bulk_update+0x60: cmpb $0xff,0x14e(%r15)
TID PID UID PRFLAGS PFLAGS CPU COMMAND
*109809 58944 0 0x14000 0x40000200 0K softclock
pfsync_bulk_update(0) at pfsync_bulk_update+0x60
softclock_thread(ffff8000fffff050) at softclock_thread+0x13b
end trace frame: 0x0, count: 13
https://www.openbsd.org/ddb.html describes the minimum info required in
bug reports. Insufficient info makes it difficult to find and fix bugs.
ddb{0}>
ddb{0}> show panic
*cpu0: uvm_fault(0xffffffff824fb2f8, 0x14e, 0, 1) -> e
ddb{0}>
ddb{0}> show reg
rdi 0xffffffff8246e4f0 pf_state_list+0x20
rsi 0
rbp 0xffff800022d4e770
rbx 0
rdx 0x8
rcx 0
rax 0
r8 0x1
r9 0xffffffff823ed8a0 rw_ops+0x10
r10 0xffffffffffffffff
r11 0xfbec2dfc846efdb5
r12 0
r13 0xffffffff82503f80 timeout_proc
r14 0xffff8000009d8000
r15 0
rip 0xffffffff8101aea0 pfsync_bulk_update+0x60
cs 0x8
rflags 0x10246 __ALIGN_SIZE+0xf246
rsp 0xffff800022d4e730
ss 0x10
pfsync_bulk_update+0x60: cmpb $0xff,0x14e(%r15)
ddb{0}>
ddb{0}> ps
PID TID PPID UID S FLAGS WAIT COMMAND
93740 394835 81774 0 3 0x100083 kqread nc
81774 496264 70017 0 3 0x10008b sigsusp ksh
70017 206227 91906 1000 3 0x10008b sigsusp ksh
91906 444000 25030 1000 3 0x98 kqread sshd
25030 312993 32675 0 3 0x82 kqread sshd
96231 49191 1 0 3 0x100083 ttyin ksh
72915 376384 1 0 3 0x100098 kqread cron
60741 488245 63219 95 3 0x1100092 kqread smtpd
89400 9739 63219 103 3 0x1100092 kqread smtpd
79033 191305 63219 95 3 0x1100092 kqread smtpd
15380 326381 63219 95 3 0x100092 kqread smtpd
79851 48142 63219 95 3 0x1100092 kqread smtpd
54647 119423 63219 95 3 0x1100092 kqread smtpd
63219 349892 1 0 3 0x100080 kqread smtpd
32675 353963 1 0 3 0x88 kqread sshd
305 206188 74189 68 3 0x1000090 netio sasyncd
74189 69953 1 0 3 0x80 kqread sasyncd
44410 420475 33657 68 3 0x1000090 kqread isakmpd
33657 253119 1 0 3 0x80 netio isakmpd
1473 362231 1 0 3 0x100080 kqread ntpd
89472 60847 21903 83 3 0x100092 kqread ntpd
21903 246700 1 83 3 0x1100092 kqread ntpd
84686 170561 2137 74 3 0x1100092 bpf pflogd
2137 127457 1 0 3 0x80 netio pflogd
62529 13576 71254 73 3 0x1100090 kqread syslogd
71254 390377 1 0 3 0x100082 netio syslogd
90876 33802 0 0 3 0x14200 bored smr
17280 168493 0 0 3 0x14200 pgzero zerothread
1554 386528 0 0 3 0x14200 aiodoned aiodoned
94598 210342 0 0 3 0x14200 syncer update
6489 371823 0 0 3 0x14200 cleaner cleaner
39420 487504 0 0 3 0x14200 reaper reaper
11739 325710 0 0 3 0x14200 pgdaemon pagedaemon
95295 157071 0 0 3 0x14200 usbtsk usbtask
66955 387875 0 0 3 0x14200 usbatsk usbatsk
82597 453160 0 0 3 0x40014200 acpi0 acpi0
92117 11003 0 0 7 0x40014200 idle5
70214 229482 0 0 7 0x40014200 idle4
69647 120031 0 0 7 0x40014200 idle3
65019 239044 0 0 7 0x40014200 idle2
14522 420624 0 0 7 0x40014200 idle1
8117 165381 0 0 3 0x14200 bored sensors
28022 59117 0 0 3 0x14200 bored softnet
63921 524180 0 0 3 0x14200 bored softnet
31177 76711 0 0 3 0x14200 bored softnet
4559 348086 0 0 3 0x14200 bored softnet
44345 324306 0 0 3 0x14200 bored systqmp
82977 433458 0 0 3 0x14200 bored systq
*58944 109809 0 0 7 0x40014200 softclock
65394 516920 0 0 3 0x40014200 idle0
1 131823 0 0 3 0x82 wait init
0 0 -1 0 3 0x10200 scheduler swapper
ddb{0}> ps /o
TID PID UID PRFLAGS PFLAGS CPU COMMAND
*109809 58944 0 0x14000 0x40000200 0K softclock
ddb{0}> trace /t 0t109809
ffff800022d4e680(uvm_fault(0xffffffff82554048, 0xfffffffffffffffe, 0, 1)
-> e
kernel: page fault trap, code=0
Faulted in DDB; continuing...
ddb{0}>
ddb{0}> mach ddbcpu 1
Stopped at x86_ipi_db+0x12: leave
x86_ipi_db(ffff800022509ff0) at x86_ipi_db+0x12
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
acpicpu_idle() at acpicpu_idle+0x281
sched_idle(ffff800022509ff0) at sched_idle+0x280
end trace frame: 0x0, count: 10
ddb{1}> mach ddbcpu 2
Stopped at x86_ipi_db+0x12: leave
x86_ipi_db(ffff800022512ff0) at x86_ipi_db+0x12
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
acpicpu_idle() at acpicpu_idle+0x281
sched_idle(ffff800022512ff0) at sched_idle+0x280
end trace frame: 0x0, count: 10
ddb{2}> mach ddbcpu 3
Stopped at x86_ipi_db+0x12: leave
x86_ipi_db(ffff80002251bff0) at x86_ipi_db+0x12
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
acpicpu_idle() at acpicpu_idle+0x281
sched_idle(ffff80002251bff0) at sched_idle+0x280
end trace frame: 0x0, count: 10
ddb{3}> mach ddbcpu 4
Stopped at x86_ipi_db+0x12: leave
x86_ipi_db(ffff800022524ff0) at x86_ipi_db+0x12
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
acpicpu_idle() at acpicpu_idle+0x281
sched_idle(ffff800022524ff0) at sched_idle+0x280
end trace frame: 0x0, count: 10
ddb{4}> mach ddbcpu 5
Stopped at x86_ipi_db+0x12: leave
x86_ipi_db(ffff80002252dff0) at x86_ipi_db+0x12
x86_ipi_handler() at x86_ipi_handler+0x80
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
acpicpu_idle() at acpicpu_idle+0x281
sched_idle(ffff80002252dff0) at sched_idle+0x280
end trace frame: 0x0, count: 10
ddb{5}> mach ddbcpu 0
Stopped at pfsync_bulk_update+0x60: cmpb $0xff,0x14e(%r15)
pfsync_bulk_update(0) at pfsync_bulk_update+0x60
softclock_thread(ffff8000fffff050) at softclock_thread+0x13b
end trace frame: 0x0, count: 13
ddb{0}>
