On 05/25/11 09:05, Jeff Ross wrote:
On 05/24/11 01:52, Artur Grabowski wrote:
There is no such thing as a "bad frame pointer crash". That's a
diagnostic message from ddb that it can't find anything further up the
stack trace, which is correct, since the function sched_sync is on top
of the stack.
Now, what the kernel tells you is that your kernel didn't panic, so
I'm not entirely sure how you end up in ddb, since there is no panic
or fault in the traceback. What does the traceback on other cpus show?
"machine ddbcpu 0" will switch to cpu0, make a trace on each of them.
//art
Thanks, Art.
I was advised to try a current snapshot so if the server crashes again
with the same problem I will be sure to get the traceback from the rest
of the cpus.
Jeff
I just got dumped into ddb on this machine again--same basic message.
As suggested by Art above, I'm including the trace from each CPU,
followed by ps. I've now completely locked up the server (no response
from the console) so I can't get the most recent dmesg from the i386
snapshot I installed on May 25.
Thanks,
Jeff
ddb{1}> show panic
the kernel did not panic
ddb{1}> trace
handle_workitem_freeblocks(e02fde74,f0a0fa84,f05fbf2c,d03e1925) at
handle_worki
tem_freeblocks+0x2b
process_worklist_item(0,0,f05fbf5c,d03e1b8f,f05fbf44) at
process_worklist_item+
0x171
softdep_process_worklist(0,28,d08c6d1b,0,d03d2c83) at
softdep_process_worklist+
0x13f
sched_sync(daea73b8) at sched_sync+0xe5
Bad frame pointer: 0xd0baee88
ddb{1}> ddb{1}> machine ddbcpu 0
Stopped at Debugger+0x4: popl %ebp
ddb{0}> trace
Debugger(d0af6100,30,f05afec4,296,d0af6134) at Debugger+0x4
i386_ipi_handler(b0,20,f05a0000,d0400010,d09c0010) at i386_ipi_handler+0x5f
Xintripi() at Xintripi+0x49
--- interrupt ---
__mp_lock(d0a39c24,d0a39c24,f05aff18,d0202630,0) at __mp_lock+0x55
i386_softintlock(0,d03e0020,d0a30000,10,d0af0010) at i386_softintlock+0x12
Xintrltimer() at Xintrltimer+0x50
--- interrupt ---
cpu_idle_cycle(d0af6100) at cpu_idle_cycle+0xf
Bad frame pointer: 0xd0baee48
ddb{0}> machine ddbcpu 1
Stopped at handle_workitem_freeblocks+0x2b: movl
0x10(%eax),%eax
ddb{1}> trace
handle_workitem_freeblocks(e02fde74,f0a0fa84,f05fbf2c,d03e1925) at
handle_worki
tem_freeblocks+0x2b
process_worklist_item(0,0,f05fbf5c,d03e1b8f,f05fbf44) at
process_worklist_item+
0x171
softdep_process_worklist(0,28,d08c6d1b,0,d03d2c83) at
softdep_process_worklist+
0x13f
sched_sync(daea73b8) at sched_sync+0xe5
Bad frame pointer: 0xd0baee88
ddb{1}> machine ddbcpu 2
Stopped at Debugger+0x4: popl %ebp
ddb{2}> trace
Debugger(d4ec7c00,f05b1ec0,d03e4eb6,200296,d4ec7c34) at Debugger+0x4
i386_ipi_handler(b0,f05b0020,d03e0000,d0a30010,56630010) at
i386_ipi_handler+0x
5f
Xintripi() at Xintripi+0x49
--- interrupt ---
__mp_lock(d0a39c24,f05b1f18,f05b1f18,d0202630,0) at __mp_lock+0x52
i386_softintlock(0,d03e0020,d0a30000,10,d4ec0010) at i386_softintlock+0x12
Xintrltimer() at Xintrltimer+0x50
--- interrupt ---
cpu_idle_cycle(d4ec7c00) at cpu_idle_cycle+0xf
Bad frame pointer: 0xd0baee48
ddb{2}> machine ddbcpu 3
Stopped at Debugger+0x4: popl %ebp
ddb{3}> trace
Debugger(d4ec7800,dfd31ec0,d03e4eb6,200296,d4ec7834) at Debugger+0x4
i386_ipi_handler(b0,dfd30020,d03e0000,d0a30010,b2640010) at
i386_ipi_handler+0x
5f
Xintripi() at Xintripi+0x49
--- interrupt ---
__mp_lock(d0a39c24,dfd31f18,dfd31f18,d0202630,0) at __mp_lock+0x52
i386_softintlock(0,d03e0020,d0a30000,10,d4ec0010) at i386_softintlock+0x12
Xintrltimer() at Xintrltimer+0x50
--- interrupt ---
cpu_idle_cycle(d4ec7800) at cpu_idle_cycle+0xf
Bad frame pointer: 0xd0baee48
ddb{3}> ps
PID PPID PGRP UID S FLAGS WAIT COMMAND
14144 15869 9572 0 3 0x2000080 nanosleep sleep
15869 9572 9572 0 3 0x2000080 pause sh
9572 6705 9572 0 3 0x2000080 pause sh
6705 7305 7305 0 3 0x2000080 piperd cron
29531 14027 29531 503 3 0x2000088 poll postgres
12452 14027 12452 503 3 0x2000088 select postgres
29034 14027 29034 503 3 0x2000088 select postgres
15874 14027 15874 503 3 0x2000088 select postgres
14027 20489 4672 503 3 0x2000088 select postgres
23241 1 23241 0 3 0x2000080 ttyin getty
14849 1 14849 0 3 0x2000080 ttyin getty
14102 1 14102 0 3 0x2000080 ttyin getty
26245 1 26245 0 3 0x2000080 ttyin getty
13147 1 13147 0 3 0x2000080 ttyin getty
27251 1 27251 0 3 0x2000080 ttyin getty
23534 1 23534 0 3 0x2000080 poll wsmoused
7305 1 7305 0 3 0x2000080 select cron
31278 1 31278 0 3 0x2080080 nanosleep sensorsd
14640 1 14640 62 3 0x2000080 bpf spamlogd
28612 29277 29277 62 3 0x2000080 piperd spamd
29823 29277 29277 62 3 0x2000080 select spamd
29277 1 29277 62 3 0x2000080 nanosleep spamd
13199 1 13199 0 3 0x2000080 select inetd
10196 1 10196 0 3 0x2000080 select sshd
690 0 0 0 3 0x2100280 nfsidl nfsio
227 0 0 0 3 0x2100280 nfsidl nfsio
27597 0 0 0 3 0x2100280 nfsidl nfsio
2602 0 0 0 3 0x2100280 nfsidl nfsio
24610 16349 30391 83 3 0x2000080 poll ntpd
16349 30391 30391 83 3 0x2000080 poll ntpd
30391 1 30391 0 3 0x2000080 poll ntpd
15473 27940 27940 74 3 0x2000080 bpf pflogd
27940 1 27940 0 3 0x2000080 netio pflogd
18662 26786 4672 7794 3 0x2000080 piperd qmail-clean
16987 26786 4672 7795 3 0x2000080 select qmail-rspawn
2808 26786 4672 0 3 0x2000080 select qmail-lspawn
26457 29527 4672 73 3 0x2000080 piperd multilog
4055 18977 4672 73 3 0x2000080 piperd multilog
9926 28805 4672 7792 3 0x2000080 piperd multilog
14611 28887 4672 73 3 0x2000080 netio socklog
25391 9098 4672 1001 3 0x2000080 poll dnscache
26786 25176 4672 7796 3 0x2000080 select qmail-send
18518 488 4672 1002 3 0x2000080 piperd multilog
29527 923 4672 0 3 0x2000080 poll supervise
20489 923 4672 0 3 0x2000080 poll supervise
18977 923 4672 0 3 0x2000080 poll supervise
28887 923 4672 0 3 0x2000080 poll supervise
28805 923 4672 0 3 0x2000080 poll supervise
25176 923 4672 0 3 0x2000080 poll supervise
488 923 4672 0 3 0x2000080 poll supervise
9098 923 4672 0 3 0x2000080 poll supervise
15413 4672 4672 0 3 0x2000080 piperd readproctitle
923 4672 4672 0 3 0x2000080 nanosleep svscan
4672 1 4672 0 3 0x2000080 pause sh
17 0 0 0 3 0x2100200 aiodoned aiodoned
16 0 0 0 7 0x2100200 update
15 0 0 0 3 0x2100200 cleaner cleaner
14 0 0 0 3 0x100200 reaper reaper
13 0 0 0 3 0x2100200 pgdaemon pagedaemon
12 0 0 0 3 0x2100200 bored crypto
11 0 0 0 3 0x2100200 pftm pfpurge
10 0 0 0 3 0x2100200 usbtsk usbtask
9 0 0 0 3 0x2100200 usbatsk usbatsk
8 0 0 0 3 0x2100200 acpi0 acpi0
* 7 0 0 0 7 0x40100200 idle3
6 0 0 0 7 0x40100200 idle2
5 0 0 0 3 0x40100200 idle1
4 0 0 0 3 0x2100200 bored syswq
3 0 0 0 7 0x40100200 idle0
2 0 0 0 3 0x2100200 kmalloc kmthread
1 0 1 0 3 0x2000080 wait init
0 -1 0 0 3 0x2080200 scheduler swapper
