#18462: Kernel oops: 17 - during heavy iptables redirect rules
-----------------------------+----------------------------------
Reporter: thewerthfam@… | Owner: developers
Type: defect | Status: new
Priority: high | Milestone: Chaos Calmer (trunk)
Component: kernel | Version: Trunk
Keywords: kernel oops nat |
-----------------------------+----------------------------------
Ruuning a Banana pi Sunxi platform with latest CC from week of November
25th. Version doesn't matter that much really this issue has been going
on for 2 months now. Just taken me this long to narrow down the
conditions of the core dump.
Configuration is 1 RTL USB wifi adapter, Internal ethernet split into 3
VLANs, 1 VLAN is for the WAN, 2 other VLANS are bridged with the wifi to
add more local lan ports to the device.
System is running apache as a transparent forward proxy. Firewall has a
port 80 redirect from the LAN/wifi to the apache forward proxy.
The system will core dump when setup with the transparent proxy firewall
redirect rules and under user load. So if you have one client, and
visiting one simple site it will work fine. If that one client visits a
news site with 150+ gets or open a bunch of tabs then it will crash after
a very short while.
To narrow down the bug I've taken the transparent proxy redirect firewall
out and configured the browser to use the proxy address - this turns out
fine, no crash even under heavy load.
If you take the proxy out of the picture, and just use the NAT feature for
all the clients. It seems to do fine under load in this test case also.
Below find the core dump:
[ 19.859310] br-lan: port 1(eth0.3) entered forwarding state
[ 19.869319] br-lan: port 2(eth0.4) entered forwarding state
[ 19.879307] br-lan: port 3(eth0.5) entered forwarding state
[ 238.647211] Unable to handle kernel NULL pointer dereference at virtual
addr8
[ 238.655360] pgd = eb83c000
[ 238.658076] [00000268] *pgd=6c5b9831, *pte=00000000, *ppte=00000000
[ 238.664402] Internal error: Oops: 17 [#1] PREEMPT SMP ARM
[ 238.669795] Modules linked in: rtl8192cu rtl_usb rtl8192c_common
iptable_nat6
[ 238.777531] CPU: 0 PID: 2062 Comm: httpd Not tainted 3.14.18 #1
[ 238.783446] task: edda3740 ti: eb836000 task.ti: eb836000
[ 238.788856] PC is at nf_xfrm_me_harder+0x18/0x108 [nf_nat]
[ 238.794340] LR is at nf_nat_ipv4_local_fn+0xec/0x110 [iptable_nat]
[ 238.800515] pc : [<bf16b734>] lr : [<bf33c3d4>] psr: 80000113
[ 238.800515] sp : eb8378a8 ip : eb837908 fp : eb837904
[ 238.811975] r10: 80000000 r9 : c04d1e1c r8 : ee02c180
[ 238.817194] r7 : 00000000 r6 : ee01a000 r5 : 00000001 r4 : ee02c180
[ 238.823712] r3 : 00000000 r2 : 00000004 r1 : 00000002 r0 : ee02c180
[ 238.830232] Flags: Nzcv IRQs on FIQs on Mode SVC_32 ISA ARM
Segment user
[ 238.837358] Control: 10c5387d Table: 6b83c06a DAC: 00000015
[ 238.843097] Process httpd (pid: 2062, stack limit = 0xeb836240)
[ 238.849009] Stack: (0xeb8378a8 to 0xeb838000)
[ 238.853365] 78a0: 0002901f 00000003 00000000 00000000
00004
[ 238.861536] 78c0: eb8378fc 00000000 ede63300 ee02c180 c04e5700 0128a8c0
ab280
[ 238.869707] 78e0: c0327448 ee01a000 00000000 ee02c180 ee02c180 00000001
eb838
[ 238.877877] 7900: bf33c3d4 bf16b728 c0327448 00000000 eb837984 c0327448
eb838
[ 238.886048] 7920: c031e1b8 bf33c2f4 c0327448 c009c56c c02e7748 bf33c5c8
eb830
[ 238.894219] 7940: 00000003 ee02c180 c0327448 ee01a000 00000000 eb837984
eb838
[ 238.902389] 7960: c031e278 c031e158 ee01a000 eb837984 c0327448 80000000
0000c
[ 238.910560] 7980: eb8379bc bf33c5c8 c02e7754 ee02c180 ee1c4000 00000000
eb8a4
[ 238.918730] 79a0: 0128a8c0 edea6c80 eb8379dc eb8379b8 c032957c c031e208
ee018
[ 238.926900] 79c0: 80000000 ecddf780 eb837a34 ee02c180 eb8379f4 eb8379e0
c0320
[ 238.935071] 79e0: 00000000 ee02c180 eb837a34 eb8379f8 c0329780 c0329590
00008
[ 238.943241] 7a00: 00e03f88 ab28a8c0 ec80ccbd ede14900 ecddf780 ee1c4000
ee020
[ 238.951411] 7a20: edea6c80 00000000 eb837adc eb837a38 c0345754 c03295c4
00004
[ 238.959581] 7a40: ede14900 eb98abf8 eb837a84 00000000 ab28a8c0 00ff70c0
00000
[ 238.967751] 7a60: 00000000 ff000000 00000000 00000000 00000000 00000000
eb838
[ 238.975921] 7a80: 00e03f88 00000000 eb00771b 05b40000 00000007 00000001
00000
[ 238.984091] 7aa0: 00000000 0128a8c0 ab28a8c0 901f0004 bf16b0dc ee1c4000
ede10
[ 238.992262] 7ac0: eb98abd4 00000068 eb98abe8 c04e5700 eb837b3c eb837ae0
c0338
[ 239.000432] 7ae0: 0128a8c0 ab28a8c0 000019a3 416559a3 eb837b3c eb837b00
c032c
[ 239.008603] 7b00: 00000004 64188000 eb837b24 000019a3 ee1c4054 ede14900
ede10
[ 239.016773] 7b20: ee1c4000 eb98abd4 00000068 eb98abe8 eb837b7c eb837b40
c0340
[ 239.024944] 7b40: 0128a8c0 00001f90 00000007 000019a3 edda3740 ede14900
ede10
[ 239.033114] 7b60: ee1c4058 ee1c4000 00000000 00000004 eb837bd4 eb837b80
c034c
[ 239.041285] 7b80: 0128a8c0 00001f90 00000007 ede14900 c0323a4c 00000000
00000
[ 239.049455] 7ba0: ab28a8c0 00000007 c031e318 c0470ec4 c04d25c4 ede14900
00000
[ 239.057626] 7bc0: ee01a000 c04d1718 eb837bfc eb837bd8 c0323b6c c0345e5c
00000
[ 239.065796] 7be0: eb98ab80 ede14900 00000000 ede14900 eb837c24 eb837c00
c0328
[ 239.073967] 7c00: 00000000 c0323a4c 80000000 ede14900 ee01a000 eb98abd4
eb838
[ 239.082137] 7c20: c0324090 c03241ec ee01a000 0000a417 00000000 00000054
eb987
[ 239.090308] 7c40: eb837c84 eb837c50 c0324684 c0323ce4 00000000 c0323cd8
80008
[ 239.098479] 7c60: ede14900 c04d2b44 c04d1704 00000008 ee01a000 00000000
eb838
[ 239.106649] 7c80: c02f4adc c03242a4 c033ed3c 00000000 c04eaf80 c04d1708
eb830
[ 239.114820] 7ca0: eb837ce4 ede14900 c00bdaf8 c04d1718 c02e7748 c04d1708
ede16
[ 239.122990] 7cc0: eb98ab80 ede14900 eb98abc6 ee01a480 eb837cf4 eb837ce0
c02f8
[ 239.131161] 7ce0: c04d1708 ede14900 eb837d24 eb837cf8 c02f4c98 c02f4b98
00000
[ 239.139332] 7d00: 00000000 4d098011 00000028 0000003c ee01a000 ee3a9200
eb838
[ 239.147502] 7d20: c02f4cf0 c02f4c20 eb837d4c eb837d38 c038b4bc c02f4cec
00000
[ 239.155673] 7d40: eb837d84 eb837d50 c038b794 c038b458 00000000 eb98abd4
eb980
[ 239.163843] 7d60: 00000003 ee3a9200 eb98ab80 eb837dcc c038b7ec c04d1710
eb838
[ 239.172013] 7d80: c038b9ec c038b4d4 ede14900 eb837dcc 00000001 c04ccb24
eebcc
[ 239.180184] 7da0: eb837e04 eb837db0 c02f4918 c038b7f8 00000004 00000000
c04e8
[ 239.188354] 7dc0: c0358e20 c0060fec 0006b98a ede14900 eb837e1c c04d1710
c0018
[ 239.196546] 7de0: ede14900 ede14900 0000004e 00000001 00000017 eebc8540
eb838
[ 239.204727] 7e00: c02f4c00 c02f4428 c04d1708 ede14900 eb837e4c eb837e20
c02f8
[ 239.212897] 7e20: c0009d70 00001003 ede14900 ede14900 0000004e 00000001
00000
[ 239.221068] 7e40: eb837e64 eb837e50 c02f5404 c02f4c20 00001003 00000058
eb838
[ 239.229239] 7e60: c0275bf0 c02f53d4 00000000 eb837e78 00000000 c02d4110
c04d0
[ 239.237409] 7e80: 00000040 eebc8480 eebc8680 00000000 eb837edc 00000001
eebc0
[ 239.245580] 7ea0: 0000012c eefdcb00 c04d00c0 eefdcb08 eb837ef4 eb837ec0
c02f4
[ 239.253750] 7ec0: c04d40b0 ffffe80a ee80b900 00000000 c04d008c c04d0080
40000
[ 239.261920] 7ee0: 00000100 00000003 eb837f54 eb837ef8 c0027764 c02f63b4
f0000
[ 239.270091] 7f00: 00400140 c042ab84 eb836038 ffffe809 c04d00c0 c0580300
00000
[ 239.278261] 7f20: c04cb318 c04d0080 eb837f54 eb836018 00000075 00000000
f0000
[ 239.286432] 7f40: 0000000d 00000001 eb837f6c eb837f58 c0027b34 c002765c
0000c
[ 239.294604] 7f60: eb837f8c eb837f70 c0017c5c c0027aa0 000000a0 f000200c
c04d0
[ 239.302774] 7f80: eb837fac eb837f90 c0008570 c0017be0 00031538 60000010
ffff0
[ 239.310944] 7fa0: 00000000 eb837fb0 c00097a0 c0008534 01053aa8 01053c78
01050
[ 239.319114] 7fc0: 01053aa8 010574e0 010574e4 00000000 000d94f0 0000000d
00008
[ 239.327285] 7fe0: 000d9538 bee1f688 b6d5ab80 00031538 60000010 ffffffff
fffff
[ 239.335449] Backtrace:
[ 239.337941] [<bf16b71c>] (nf_xfrm_me_harder [nf_nat]) from [<bf33c3d4>]
(nf_)
[ 239.348706] r5:00000001 r4:ee02c180
[ 239.352314] [<bf33c2e8>] (nf_nat_ipv4_local_fn [iptable_nat]) from
[<c031e1b)
[ 239.361605] r5:c0327448 r4:eb837984
[ 239.365206] [<c031e14c>] (nf_iterate) from [<c031e278>]
(nf_hook_slow+0x7c/0)
[ 239.372678] r10:eb837984 r9:00000000 r8:ee01a000 r7:c0327448
r6:ee02c180 r53
[ 239.380560] r4:ee02c180
[ 239.383110] [<c031e1fc>] (nf_hook_slow) from [<c032957c>]
(__ip_local_out+0x)
[ 239.390842] r10:edea6c80 r9:0128a8c0 r8:000000c4 r7:eb8a1a00
r6:00000000 r50
[ 239.398723] r4:ee02c180
[ 239.401269] [<c03294f4>] (__ip_local_out) from [<c0329598>]
(ip_local_out+0x)
[ 239.409001] r4:ee02c180
[ 239.411548] [<c0329584>] (ip_local_out) from [<c0329780>]
(ip_build_and_send)
[ 239.420059] r4:ee02c180 r3:00000000
[ 239.423662] [<c03295b8>] (ip_build_and_send_pkt) from [<c0345754>]
(tcp_v4_c)
[ 239.432778] r10:00000000 r9:edea6c80 r8:00000000 r7:ee02c180
r6:ee1c4000 r50
[ 239.440660] r4:ede14900
[ 239.443210] [<c0344fec>] (tcp_v4_conn_request) from [<c033c260>]
(tcp_rcv_st)
[ 239.452242] r10:c04e5700 r9:eb98abe8 r8:00000068 r7:eb98abd4
r6:00000000 r50
[ 239.460123] r4:ee1c4000
[ 239.462671] [<c033c1e4>] (tcp_rcv_state_process) from [<c0343534>]
(tcp_v4_d)
[ 239.471260] r9:eb98abe8 r8:00000068 r7:eb98abd4 r6:ee1c4000
r5:ee1c4000 r4:0
[ 239.479059] [<c0343250>] (tcp_v4_do_rcv) from [<c0346204>]
(tcp_v4_rcv+0x3b4)
[ 239.486703] r9:00000004 r8:00000000 r7:ee1c4000 r6:ee1c4058
r5:c04e5700 r4:0
[ 239.494505] [<c0345e50>] (tcp_v4_rcv) from [<c0323b6c>]
(ip_local_deliver_fi)
[ 239.503016] r10:c04d1718 r9:ee01a000 r8:c04e5700 r7:00000000
r6:ede14900 r54
[ 239.510898] r4:c0470ec4
[ 239.513447] [<c0323a4c>] (ip_local_deliver_finish) from [<c0324250>]
(ip_loc)
[ 239.522305] r8:ede14900 r7:00000000 r6:ede14900 r5:eb98ab80
r4:ede14900 r3:1
[ 239.530105] [<c03241e0>] (ip_local_deliver) from [<c0324090>]
(ip_rcv_finish)
[ 239.538269] r4:eb98abd4
[ 239.540818] [<c0323cd8>] (ip_rcv_finish) from [<c0324684>]
(ip_rcv+0x3ec/0x4)
[ 239.548115] r6:0000a417 r5:eb98ab80 r4:00000054
[ 239.552772] [<c0324298>] (ip_rcv) from [<c02f4adc>]
(__netif_receive_skb_cor)
[ 239.561024] r9:00000000 r8:ee01a000 r7:00000008 r6:c04d1704
r5:c04d2b44 r4:0
[ 239.568824] [<c02f441c>] (__netif_receive_skb_core) from [<c02f4c00>]
(__net)
[ 239.578029] r10:ee01a480 r9:eb98abc6 r8:ede14900 r7:eb98ab80
r6:00000046 r50
[ 239.585910] r4:c04d1708
[ 239.588458] [<c02f4b8c>] (__netif_receive_skb) from [<c02f4c98>]
(netif_rece)
[ 239.597835] r5:ede14900 r4:c04d1708
[ 239.601436] [<c02f4c14>] (netif_receive_skb_internal) from [<c02f4cf0>]
(net)
[ 239.610640] r5:ee3a9200 r4:ee01a000
[ 239.614243] [<c02f4ce0>] (netif_receive_skb) from [<c038b4bc>]
(br_pass_fram)
[ 239.622588] [<c038b44c>] (br_pass_frame_up) from [<c038b794>]
(br_handle_fra)
[ 239.631532] r4:ede14900 r3:00000001
[ 239.635131] [<c038b4c8>] (br_handle_frame_finish) from [<c038b9ec>]
(br_hand)
[ 239.643989] r10:c04d1710 r9:c038b7ec r8:eb837dcc r7:eb98ab80
r6:ee3a9200 r53
[ 239.651870] r4:ede14900
[ 239.654418] [<c038b7ec>] (br_handle_frame) from [<c02f4918>]
(__netif_receiv)
[ 239.663449] r9:c038b7ec r8:eebc8000 r7:c04ccb24 r6:00000001
r5:eb837dcc r4:0
[ 239.671249] [<c02f441c>] (__netif_receive_skb_core) from [<c02f4c00>]
(__net)
[ 239.680453] r10:eebc8540 r9:00000017 r8:00000001 r7:0000004e
r6:ede14900 r50
[ 239.688333] r4:c04d1708
[ 239.690882] [<c02f4b8c>] (__netif_receive_skb) from [<c02f4c98>]
(netif_rece)
[ 239.700259] r5:ede14900 r4:c04d1708
[ 239.703860] [<c02f4c14>] (netif_receive_skb_internal) from [<c02f5404>]
(nap)
[ 239.712977] r5:ede14900 r4:00000003
[ 239.716581] [<c02f53c8>] (napi_gro_receive) from [<c0275bf0>]
(stmmac_poll+0)
[ 239.724572] r5:00000058 r4:00001003
[ 239.728174] [<c0275818>] (stmmac_poll) from [<c02f6430>]
(net_rx_action+0x88)
[ 239.735818] r10:eefdcb08 r9:c04d00c0 r8:eefdcb00 r7:0000012c
r6:00000040 r50
[ 239.743699] r4:00000001
[ 239.746248] [<c02f63a8>] (net_rx_action) from [<c0027764>]
(__do_softirq+0x1)
[ 239.754065] r10:00000003 r9:00000100 r8:eb836000 r7:40000003
r6:c04d0080 r5c
[ 239.761946] r4:00000000
[ 239.764492] [<c0027650>] (__do_softirq) from [<c0027b34>]
(irq_exit+0xa0/0xe)
[ 239.771703] r10:00000001 r9:0000000d r8:000d94f0 r7:f0002000
r6:00000000 r55
[ 239.779584] r4:eb836018
[ 239.782132] [<c0027a94>] (irq_exit) from [<c0017c5c>]
(handle_IRQ+0x88/0x94)
[ 239.789170] r4:c04cbc6c r3:000000e8
[ 239.792770] [<c0017bd4>] (handle_IRQ) from [<c0008570>]
(gic_handle_irq+0x48)
[ 239.800328] r6:eb837fb0 r5:c04d14a8 r4:f000200c r3:000000a0
[ 239.806034] [<c0008528>] (gic_handle_irq) from [<c00097a0>]
(__irq_usr+0x40/)
[ 239.813507] Exception stack(0xeb837fb0 to 0xeb837ff8)
[ 239.818555] 7fa0: 01053aa8 01053c78
01050
[ 239.826725] 7fc0: 01053aa8 010574e0 010574e4 00000000 000d94f0 0000000d
00008
[ 239.834893] 7fe0: 000d9538 bee1f688 b6d5ab80 00031538 60000010 ffffffff
[ 239.841497] r7:00000000 r6:ffffffff r5:60000010 r4:00031538
[ 239.847204] Code: e24cb004 e24dd048 e5903014 e1a04000 (e5933268)
[ 239.853386] ---[ end trace 16df71004f4fbbfa ]---
[ 239.858015] Kernel panic - not syncing: Fatal exception in interrupt
[ 239.864366] CPU1: stopping
[ 239.867083] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G D
3.14.18 #1
[ 239.874034] Backtrace:
[ 239.876505] [<c001a380>] (dump_backtrace) from [<c001a664>]
(show_stack+0x18)
[ 239.884063] r6:00000000 r5:ee8ac010 r4:c04e2fb0 r3:00000000
[ 239.889774] [<c001a64c>] (show_stack) from [<c01b8e10>]
(dump_stack+0xa0/0xd)
[ 239.896993] [<c01b8d70>] (dump_stack) from [<c001b9f8>]
(handle_IPI+0xe8/0x1)
[ 239.904290] r6:00000000 r5:c04cbc6c r4:00000001 r3:60000193
[ 239.909996] [<c001b910>] (handle_IPI) from [<c0008588>]
(gic_handle_irq+0x60)
[ 239.917553] r6:ee8adf70 r5:c04d14a8 r4:f000200c r3:c0017dd8
[ 239.923258] [<c0008528>] (gic_handle_irq) from [<c00095e0>]
(__irq_svc+0x40/)
[ 239.930730] Exception stack(0xee8adf70 to 0xee8adfb8)
[ 239.935779] df60: eefe3568 00000000
00000
[ 239.943950] df80: ee8ac000 c04d1110 c0412f88 ee8ac000 c04d3fd1 c04d3fd1
ee8a4
[ 239.952119] dfa0: ee8adfc8 ee8adfb8 c0017dd8 c0017ddc 60000013 ffffffff
[ 239.958722] r7:ee8adfa4 r6:ffffffff r5:60000013 r4:c0017ddc
[ 239.964432] [<c0017dac>] (arch_cpu_idle) from [<c005aef4>]
(cpu_startup_entr)
[ 239.972603] [<c005ae18>] (cpu_startup_entry) from [<c001b704>]
(secondary_st)
[ 239.981634] r7:c0589a4c r3:600001d3
[ 239.985270] [<c001b5c0>] (secondary_start_kernel) from [<40008624>]
(0x40008)
[ 239.992656] r5:00000015 r4:6e89806a
[ 239.996257] Rebooting in 3 seconds..
FYI system never reboots after this on its own. Power cycle is required.
--
Ticket URL: <https://dev.openwrt.org/ticket/18462>
OpenWrt <http://openwrt.org>
Opensource Wireless Router Technology
_______________________________________________
openwrt-tickets mailing list
[email protected]
https://lists.openwrt.org/cgi-bin/mailman/listinfo/openwrt-tickets
