Hi!
I've experiencing some problems with the kernel, under high load
(copying a big file over nfs to a crypted filesystem)
Some more infos/observations: (random order)
- kernel nfs server
- file to be copied is 100G, copied with dd-rescue (does not complete)
- using a hifn 765x crypto accelerator (vpn 1411)
- raid is degraded after the hard-reset
- after bug shows up, not able to login on the serial console
Any ideas? Any idea to help debugging the problem?
Thanks!
thecus:/home/tobi# uname -a
Linux thecus 2.6.30-1-iop32x #1 Mon Jun 15 05:25:53 UTC 2009 armv5tel
GNU/Linux
Over the serial the following is received over the serial link:
Ethernet is responding to pings, but otherwise dead.
[71275.78] swapper: page allocation failure. order:1, mode:0x20
[71275.78] Backtrace:
[71275.78] [c0026e40] (dump_backtrace+0x0/0x110) from [c02087e8]
(dump_stack+0x18/0x1c)
[71275.78] r7:c02cde5c r6:0032 r5:0020 r4:
[71275.78] [c02087d0] (dump_stack+0x0/0x1c) from [c00796a4]
(__alloc_pages_internal+0x3c4/0x3e8)
[71275.78] [c00792e0] (__alloc_pages_internal+0x0/0x3e8) from
[c0096da0] (cache_alloc_refill+0x284/0x548)
[71275.78] [c0096b1c] (cache_alloc_refill+0x0/0x548) from
[c009717c] (kmem_cache_alloc+0x50/0x88)
[71275.78] [c009712c] (kmem_cache_alloc+0x0/0x88) from
[c0185c24] (sk_prot_alloc+0x30/0xcc)
[71275.78] r7:0020 r6:df80f680 r5:c02cadec r4:29b2f5b7
[71275.78] [c0185bf4] (sk_prot_alloc+0x0/0xcc) from [c01860d8]
(sk_clone+0x20/0x1d4)
[71275.78] r8:dec8f9e0 r7:c0e0d680 r6:dec8f9e0 r5:c19cf600
r4:29b2f5b7
[71275.78] [c01860b8] (sk_clone+0x0/0x1d4) from [c01be418]
(inet_csk_clone+0x18/0x98)
[71275.78] r6:c19cf600 r5:c19cf600 r4:29b2f5b7
[71275.78] [c01be400] (inet_csk_clone+0x0/0x98) from [c01d3cf4]
(tcp_create_openreq_child+0x24/0x34c)
[71275.78] r5:c19cf600 r4:29b2f5b7
[71275.78] [c01d3cd0] (tcp_create_openreq_child+0x0/0x34c) from
[c01d2e10] (tcp_v4_syn_recv_sock+0x58/0x20c)
[71275.78] r8:c0e0d680 r7:c0cbe760 r6:dec8f9e0 r5:c19cf600
r4:29b2f5b7
[71275.78] [c01d2db8] (tcp_v4_syn_recv_sock+0x0/0x20c) from
[c01d3b04] (tcp_check_req+0x25c/0x428)
[71275.78] r8: r7:1000 r6:dec8f9e0 r5:c19cf600
r4:29b2f5b7
[71275.78] [c01d38a8] (tcp_check_req+0x0/0x428) from [c01d2114]
(tcp_v4_do_rcv+0x220/0x350)
[71275.78] [c01d1ef4] (tcp_v4_do_rcv+0x0/0x350) from [c01d273c]
(tcp_v4_rcv+0x4f8/0x7ec)
[71275.78] [c01d2244] (tcp_v4_rcv+0x0/0x7ec) from [c01b55e0]
(ip_local_deliver_finish+0x19c/0x280)
[71275.78] [c01b5444] (ip_local_deliver_finish+0x0/0x280) from
[c01b5754] (ip_local_deliver+0x90/0xa4)
[71275.78] [c01b56c4] (ip_local_deliver+0x0/0xa4) from
[c01b5184] (ip_rcv_finish+0x328/0x348)
[71275.78] r4:c0e0d680
[71275.78] [c01b4e5c] (ip_rcv_finish+0x0/0x348) from [c01b5410]
(ip_rcv+0x26c/0x2a0)
[71275.78] r7:0008 r6:de443000 r5:c0e0d680 r4:c0e0d680
[71275.78] [c01b51a4] (ip_rcv+0x0/0x2a0) from [c0191c54]
(netif_receive_skb+0x558/0x5a4)
[71275.78] r6:c02dfe4c r5:c02cbcf8 r4:c0e0d680
[71275.78] [c01916fc] (netif_receive_skb+0x0/0x5a4) from
[bf005ef4] (rtl8169_rx_interrupt+0x2bc/0x3e4 [r8169])
[71275.78] [bf005c38] (rtl8169_rx_interrupt+0x0/0x3e4 [r8169])
from [bf00741c] (rtl8169_poll+0x3c/0x19c [r8169])
[71275.78] [bf0073e0] (rtl8169_poll+0x0/0x19c [r8169]) from
[c018fd38] (net_rx_action+0x94/0x1b0)
[71275.78] [c018fca4] (net_rx_action+0x0/0x1b0) from [c003ea08]
(__do_softirq+0x6c/0xf8)
[71275.78] [c003e99c] (__do_softirq+0x0/0xf8) from [c003ead8]
(irq_exit+0x44/0x4c)
[71275.78] [c003ea94] (irq_exit+0x0/0x4c) from [c0022058] (_text
+0x58/0x6c)
[71275.78] [c0022000] (_text+0x0/0x6c) from [c0022a48]
(__irq_svc+0x48/0x80)
[71275.78] Exception stack(0xc02aff50 to 0xc02aff98)
[71275.78] ff40: 0001
de45a880 a013
[71275.78] ff60: c00243bc c02ae000 c00243bc c02cebe8 a001efa0
69052e30 a001ecfc c02affb4
[71275.78] ff80: c02aff98 c02aff98 c00243a0 c00243bc 6013
[71275.78] r5:c02aff84 r4:
[71275.78] [c0024364] (cpu_idle+0x0/0x58) from [c0203ebc]
(rest_init+0x58/0x6c)
[71275.78] r7:c02b1de8 r6:c0020ee4 r5:c02cebbc r4:c02d96f0
[71275.78] [c0203e64] (rest_init+0x0/0x6c) from [c00089b4]
(start_kernel+0x26c/0x2c8)
[71275.78] [c0008748] (start_kernel+0x0/0x2c8) from [a0008034]
(0xa0008034)
[71275.78] r6:c00212e8 r5:c02cec18 r4:397d
[71275.78] Mem-info:
[71275.78] Normal per-cpu:
[71275.78] CPU0: hi: 186, btch: 31 usd: 193
[71275.78] Active_anon:14558 active_file:2515 inactive_anon:14715
[71275.78] inactive_file:85919 unevictable:0 dirty:62324
writeback:23824 unstable:0
[71275.78] free:457 slab:7919 mapped:3 pagetables:298 bounce:0
[71275.78] Normal free:1828kB min:2884kB low:3604kB high:4324kB
active_anon:58232kB
