Hi Michal you can have an approximation of the required memory using this formula: MTU * NUM_SLOTS * 2 * NUM_QUEUES * NUM_INTERFACES
For instance with 4096 slots (default) and 2 ports with 4 RSS queues: 1500 * 4096 * 2 * 4 * 2 ~ 100 MBytes Please try after a fresh boot, when the driver has more chances to find physically contiguous memory. Best Regards Alfredo On Mar 25, 2013, at 1:29 PM, Michał Margula <[email protected]> wrote: > Hello, > > We want to use DNA drivers for nprobe, but after compiling DNA ixgbe driver > and pf_ring module, i get: > > > [43091.048135] events/1: page allocation failure. order:5, mode:0x20 > [43091.048139] Pid: 16, comm: events/1 Not tainted 2.6.32-5-amd64 #1 > [43091.048141] Call Trace: > [43091.048151] [<ffffffff810bab7f>] ? __alloc_pages_nodemask+0x59b/0x5fc > [43091.048154] [<ffffffff810b9b3c>] ? __get_free_pages+0x9/0x46 > [43091.048165] [<ffffffffa060cdc6>] ? alloc_contiguous_memory+0x116/0x190 > [ixgbe] > [43091.048172] [<ffffffffa060fcf5>] ? dna_ixgbe_alloc_rx_buffers+0x195/0x780 > [ixgbe] > [43091.048177] [<ffffffff8105ab1c>] ? try_to_del_timer_sync+0x63/0x6c > [43091.048179] [<ffffffff8105ab31>] ? del_timer_sync+0xc/0x16 > [43091.048184] [<ffffffff812fcc54>] ? schedule_timeout+0xad/0xdd > [43091.048187] [<ffffffff8105abb0>] ? process_timeout+0x0/0x5 > [43091.048189] [<ffffffff8105b05c>] ? msleep+0x14/0x1e > [43091.048194] [<ffffffffa06134f6>] ? ixgbe_configure+0x656/0x9e0 [ixgbe] > [43091.048200] [<ffffffffa0614109>] ? ixgbe_up+0x9/0x20 [ixgbe] > [43091.048205] [<ffffffffa06142ca>] ? ixgbe_reinit_locked+0xda/0xf0 [ixgbe] > [43091.048212] [<ffffffffa061e378>] ? ixgbe_set_pauseparam+0x198/0x1d0 > [ixgbe] > [43091.048217] [<ffffffffa0614601>] ? ixgbe_service_task+0x321/0xb10 [ixgbe] > [43091.048221] [<ffffffff81061c77>] ? worker_thread+0x188/0x21d > [43091.048226] [<ffffffffa06142e0>] ? ixgbe_service_task+0x0/0xb10 [ixgbe] > [43091.048229] [<ffffffff810652b2>] ? autoremove_wake_function+0x0/0x2e > [43091.048232] [<ffffffff81061aef>] ? worker_thread+0x0/0x21d > [43091.048234] [<ffffffff81064fe5>] ? kthread+0x79/0x81 > [43091.048238] [<ffffffff81011baa>] ? child_rip+0xa/0x20 > [43091.048240] [<ffffffff81064f6c>] ? kthread+0x0/0x81 > [43091.048242] [<ffffffff81011ba0>] ? child_rip+0x0/0x20 > [43091.048244] Mem-Info: > [43091.048245] Node 0 DMA per-cpu: > [43091.048247] CPU 0: hi: 0, btch: 1 usd: 0 > [43091.048249] CPU 1: hi: 0, btch: 1 usd: 0 > [43091.048250] CPU 2: hi: 0, btch: 1 usd: 0 > [43091.048252] CPU 3: hi: 0, btch: 1 usd: 0 > [43091.048254] Node 0 DMA32 per-cpu: > [43091.048256] CPU 0: hi: 186, btch: 31 usd: 161 > [43091.048257] CPU 1: hi: 186, btch: 31 usd: 162 > [43091.048259] CPU 2: hi: 186, btch: 31 usd: 186 > [43091.048261] CPU 3: hi: 186, btch: 31 usd: 28 > [43091.048265] active_anon:20172 inactive_anon:6774 isolated_anon:0 > [43091.048266] active_file:172071 inactive_file:55916 isolated_file:0 > [43091.048267] unevictable:470 dirty:509 writeback:46 unstable:0 > [43091.048268] free:210354 slab_reclaimable:20409 slab_unreclaimable:10894 > [43091.048269] mapped:3956 shmem:157 pagetables:4384 bounce:0 > [43091.048270] Node 0 DMA free:10064kB min:40kB low:48kB high:60kB > active_anon:0kB inactive_anon:0kB active_file:1132kB inactive_file:8kB > unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15296kB > mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB > slab_reclaimable:1136kB slab_unreclaimable:88kB kernel_stack:0kB > pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 > all_unreclaimable? no > [43091.048280] lowmem_reserve[]: 0 2003 2003 2003 > [43091.048283] Node 0 DMA32 free:831352kB min:5704kB low:7128kB high:8556kB > active_anon:80688kB inactive_anon:27096kB active_file:687152kB > inactive_file:223656kB unevictable:1880kB isolated(anon):0kB > isolated(file):0kB present:2051616kB mlocked:1880kB dirty:2036kB > writeback:184kB mapped:15824kB shmem:628kB slab_reclaimable:80500kB > slab_unreclaimable:43488kB kernel_stack:2944kB pagetables:17536kB > unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? > no > [43091.048292] lowmem_reserve[]: 0 0 0 0 > [43091.048294] Node 0 DMA: 183*4kB 159*8kB 135*16kB 85*32kB 48*64kB 1*128kB > 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 10084kB > [43091.048302] Node 0 DMA32: 44151*4kB 30519*8kB 7443*16kB 6518*32kB > 1296*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 831492kB > [43091.048309] 228617 total pagecache pages > [43091.048311] 119 pages in swap cache > [43091.048312] Swap cache stats: add 123, delete 4, find 814/814 > [43091.048313] Free swap = 9584148kB > [43091.048315] Total swap = 9584624kB > [43091.060439] 524143 pages RAM > [43091.060442] 13635 pages reserved > [43091.060444] 302550 pages shared > [43091.060446] 75599 pages non-shared > [43091.068181] [<ffffffffa0614109>] ? ixgbe_up+0x9/0x20 [ixgbe] > [43091.068186] [<ffffffffa06142ca>] ? ixgbe_reinit_locked+0xda/0xf0 [ixgbe] > [43091.068193] [<ffffffffa061e378>] ? ixgbe_set_pauseparam+0x198/0x1d0 > [ixgbe] > [43091.068199] [<ffffffffa0614601>] ? ixgbe_service_task+0x321/0xb10 [ixgbe] > [43091.068202] [<ffffffff81061c77>] ? worker_thread+0x188/0x21d > [43091.068207] [<ffffffffa06142e0>] ? ixgbe_service_task+0x0/0xb10 [ixgbe] > [43091.068211] [<ffffffff810652b2>] ? autoremove_wake_function+0x0/0x2e > [43091.068214] [<ffffffff81061aef>] ? worker_thread+0x0/0x21d > [43091.068216] [<ffffffff81064fe5>] ? kthread+0x79/0x81 > [43091.068220] [<ffffffff81011baa>] ? child_rip+0xa/0x20 > [43091.068222] [<ffffffff81064f6c>] ? kthread+0x0/0x81 > [43091.068224] [<ffffffff81011ba0>] ? child_rip+0x0/0x20 > [43091.068226] Mem-Info: > [43091.068227] Node 0 DMA per-cpu: > [43091.068229] CPU 0: hi: 0, btch: 1 usd: 0 > [43091.068231] CPU 1: hi: 0, btch: 1 usd: 0 > [43091.068233] CPU 2: hi: 0, btch: 1 usd: 0 > [43091.068234] CPU 3: hi: 0, btch: 1 usd: 0 > [43091.068236] Node 0 DMA32 per-cpu: > [43091.068238] CPU 0: hi: 186, btch: 31 usd: 161 > [43091.068239] CPU 1: hi: 186, btch: 31 usd: 162 > [43091.068241] CPU 2: hi: 186, btch: 31 usd: 184 > [43091.068243] CPU 3: hi: 186, btch: 31 usd: 23 > [43091.068247] active_anon:20172 inactive_anon:6774 isolated_anon:0 > [43091.068248] active_file:167614 inactive_file:45741 isolated_file:41 > [43091.068249] unevictable:470 dirty:509 writeback:46 unstable:0 > [43091.068250] free:226100 slab_reclaimable:18911 slab_unreclaimable:10894 > [43091.068250] mapped:3956 shmem:157 pagetables:4384 bounce:0 > [43091.068252] Node 0 DMA free:10004kB min:40kB low:48kB high:60kB > active_anon:0kB inactive_anon:0kB active_file:1132kB inactive_file:8kB > unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15296kB > mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB > slab_reclaimable:936kB slab_unreclaimable:88kB kernel_stack:0kB > pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 > all_unreclaimable? no > [43091.068262] lowmem_reserve[]: 0 2003 2003 2003 > [43091.068265] Node 0 DMA32 free:894520kB min:5704kB low:7128kB high:8556kB > active_anon:80688kB inactive_anon:27096kB active_file:669324kB > inactive_file:182956kB unevictable:1880kB isolated(anon):0kB > isolated(file):164kB present:2051616kB mlocked:1880kB dirty:2036kB > writeback:184kB mapped:15824kB shmem:628kB slab_reclaimable:74708kB > slab_unreclaimable:43488kB kernel_stack:2944kB pagetables:17536kB > unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? > no > [43091.068274] lowmem_reserve[]: 0 0 0 0 > [43091.068276] Node 0 DMA: 183*4kB 159*8kB 134*16kB 83*32kB 50*64kB 0*128kB > 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 10004kB > [43091.068284] Node 0 DMA32: 45776*4kB 35379*8kB 8293*16kB 6575*32kB > 1327*64kB 3*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 894536kB > [43091.068291] 214035 total pagecache pages > [43091.068293] 120 pages in swap cache > [43091.068295] Swap cache stats: add 124, delete 4, find 814/814 > [43091.068296] Free swap = 9584144kB > [43091.068297] Total swap = 9584624kB > [43091.080856] 524143 pages RAM > [43091.080860] 13987 pages reserved > [43091.080862] 290851 pages shared > [43091.080865] 74038 pages non-shared > [43091.080869] > [43091.080869] > [43091.080870] dna_ixgbe_alloc_rx_buffers() ERROR: not enough memory for RX > DMA ring!! > [43091.080871] > [43091.080871] > [43091.248013] ixgbe 0000:09:00.0: dna0: detected SFP+: 5 > [43091.500033] ixgbe 0000:09:00.0: dna0: NIC Link is Up 10 Gbps, Flow > Control: None > [43091.500475] ADDRCONF(NETDEV_CHANGE): dna0: link becomes ready > > So it seems that there is not enough memory. So how much is required? That > server has 2GB installed because it never required more. All your help will > be greatly appreciated. Thank you! > > -- > Michał Margula, [email protected], http://alchemyx.uznam.net.pl/ > "W życiu piękne są tylko chwile" [Ryszard Riedel] > _______________________________________________ > Ntop-misc mailing list > [email protected] > http://listgateway.unipi.it/mailman/listinfo/ntop-misc _______________________________________________ Ntop-misc mailing list [email protected] http://listgateway.unipi.it/mailman/listinfo/ntop-misc
