Got the following from dmesg of one of my servers last night (happened
during nightly backup over network):
kswapd0: page allocation failure. order:3, mode:0x20
[] __alloc_pages+0x28e/0x29d
[] kmem_getpages+0x34/0x9a
[] cache_grow+0x9d/0x12b
[] cache_alloc_refill+0x138/0x170
[] __kmalloc+0x62/0x70
[] __alloc_skb+0x42/0xed
[] __netdev_alloc_skb+0x1a/0x33
[] e1000_alloc_rx_buffers+0xbb/0x299 [e1000]
[] e1000_clean_rx_irq+0x407/0x425 [e1000]
[] e1000_intr+0xb9/0x109 [e1000]
[] handle_IRQ_event+0x1a/0x3f
[] handle_level_irq+0x66/0xa0
[] do_IRQ+0x5d/0x74
[] mempool_free+0x48/0x4c
[] common_interrupt+0x23/0x28
[] skb_copy_bits+0x51/0x243
[] buffered_rmqueue+0xbe/0xd7
[] __kfree_skb+0x9b/0xc5
[] tcp_collapse+0x268/0x2f4
[] tcp_prune_queue+0x96/0x144
[] tcp_data_queue+0x19e/0x64b
[] tcp_rcv_established+0x51c/0x574
[] tcp_v4_do_rcv+0x22/0xb7
[] tcp_v4_rcv+0x424/0x6c9
[] raw_rcv_skb+0x15/0x1e
[] ip_local_deliver+0x14f/0x1d4
[] ip_local_deliver_finish+0x0/0x151
[] ip_rcv+0x3c0/0x3f2
[] ip_rcv_finish+0x0/0x1fb
[] e1000_clean_rx_irq+0x407/0x425 [e1000]
[] netif_receive_skb+0x1e5/0x1fb
[] process_backlog+0x6f/0xd2
[] net_rx_action+0x76/0x106
[] __do_softirq+0x35/0x73
[] do_softirq+0x22/0x26
[] do_IRQ+0x62/0x74
[] common_interrupt+0x23/0x28
[] bit_waitqueue+0x20/0x47
[] wake_up_bit+0xb/0x16
[] dispose_list+0x88/0xa4
[] prune_icache+0x136/0x148
[] shrink_icache_memory+0x14/0x2b
[] shrink_slab+0x135/0x18e
[] balance_pgdat+0x1e6/0x2eb
[] kswapd+0xf5/0xf7
[] autoremove_wake_function+0x0/0x33
[] __wake_up_common+0x35/0x56
[] autoremove_wake_function+0x0/0x33
[] kswapd+0x0/0xf7
[] kthread+0x72/0x97
[] kthread+0x0/0x97
[] kernel_thread_helper+0x7/0x10
===
Mem-info:
DMA per-cpu:
CPU0: Hot: hi:0, btch: 1 usd: 0 Cold: hi:0, btch: 1
usd: 0
Normal per-cpu:
CPU0: Hot: hi: 186, btch: 31 usd: 143 Cold: hi: 62, btch: 15
usd: 2
HighMem per-cpu:
CPU0: Hot: hi: 42, btch: 7 usd: 40 Cold: hi: 14, btch: 3
usd: 2
Active:171834 inactive:59703 dirty:846 writeback:0 unstable:0 free:2311
slab:20911 mapped:4658 pagetables:765
DMA free:3536kB min:68kB low:84kB high:100kB active:5152kB
inactive:1232kB present:16256kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 873 1000
Normal free:5448kB min:3744kB low:4680kB high:5616kB active:569208kB
inactive:228308kB present:894080kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 1015
HighMem free:260kB min:128kB low:264kB high:400kB active:112976kB
inactive:9272kB present:129988kB pages_scanned:0 all_unreclaimable? no
lowmem_reserve[]: 0 0 0
DMA: 40*4kB 36*8kB 15*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB
0*1024kB 1*2048kB 0*4096kB = 3536kB
Normal: 152*4kB 491*8kB 45*16kB 0*32kB 1*64kB 1*128kB 0*256kB 0*512kB
0*1024kB 0*2048kB 0*4096kB = 5448kB
HighMem: 1*4kB 18*8kB 1*16kB 1*32kB 1*64kB 0*128kB 0*256kB 0*512kB
0*1024kB 0*2048kB 0*4096kB = 260kB
Swap cache: add 132, delete 132, find 0/0, race 0+0
Free swap = 16064704kB
Total swap = 16064704kB
Free swap: 16064704kB
262128 pages of RAM
32752 pages of HIGHMEM
3672 reserved pages
82110 pages shared
0 pages swap cached
846 pages dirty
0 pages writeback
4658 pages mapped
20911 pages slab
765 pages pagetables
kswapd0: page allocation failure. order:3, mode:0x20
[] __alloc_pages+0x28e/0x29d
[] kmem_getpages+0x34/0x9a
[] cache_grow+0x9d/0x12b
[] do_IRQ+0x62/0x74
[] profile_tick+0x39/0x53
[] cache_alloc_refill+0x138/0x170
[] __kmalloc+0x62/0x70
[] __alloc_skb+0x42/0xed
[] __netdev_alloc_skb+0x1a/0x33
[] e1000_alloc_rx_buffers+0xbb/0x299 [e1000]
[] e1000_clean_rx_irq+0x38e/0x425 [e1000]
[] e1000_intr+0xb9/0x109 [e1000]
[] handle_IRQ_event+0x1a/0x3f
[] handle_level_irq+0x66/0xa0
[] do_IRQ+0x5d/0x74
[] mempool_free+0x48/0x4c
[] common_interrupt+0x23/0x28
[] skb_copy_bits+0x51/0x243
[] buffered_rmqueue+0xbe/0xd7
[] __kfree_skb+0x9b/0xc5
[] tcp_collapse+0x268/0x2f4
[] tcp_prune_queue+0x96/0x144
[] tcp_data_queue+0x19e/0x64b
[] tcp_rcv_established+0x51c/0x574
[] tcp_v4_do_rcv+0x22/0xb7
[] tcp_v4_rcv+0x424/0x6c9
[] raw_rcv_skb+0x15/0x1e
[] ip_local_deliver+0x14f/0x1d4
[] ip_local_deliver_finish+0x0/0x151
[] ip_rcv+0x3c0/0x3f2
[] ip_rcv_finish+0x0/0x1fb
[] e1000_clean_rx_irq+0x407/0x425 [e1000]
[] netif_receive_skb+0x1e5/0x1fb
[] process_backlog+0x6f/0xd2
[] net_rx_action+0x76/0x106
[] __do_softirq+0x35/0x73
[] do_softirq+0x22/0x26
[] do_IRQ+0x62/0x74
[] common_interrupt+0x23/0x28
[] bit_waitqueue+0x20/0x47
[] wake_up_bit+0xb/0x16
[] dispose_list+0x88/0xa4
[] prune_icache+0x136/0x148
[] shrink_icache_memory+0x14/0x2b
[] shrink_slab+0x135/0x18e
[] balance_pgdat+0x1e6/0x2eb
[] kswapd+0xf5/0xf7
[] autoremove_wake_function+0x0/0x33
[] __wake_up_common+0x35/0x56
[] autoremove_wake_function+0x0/0x33
[] kswapd+0x0/0xf7
[] kthread+0x72/0x97
[] kthread+0x0/0x97
[] kernel_thread_helper+0x7/0x10
===
Mem-info:
DMA per-cpu:
CPU0: Hot: hi:0, btch: 1 usd:
