On Sat, Dec 3, 2016 at 2:53 AM, Alexei Starovoitov <a...@fb.com> wrote: > On 12/2/16 4:38 PM, Eric Dumazet wrote: >> >> On Fri, 2016-12-02 at 15:23 -0800, Martin KaFai Lau wrote: >>> >>> When XDP prog is attached, it is currently limiting >>> MTU to be FRAG_SZ0 - ETH_HLEN - (2 * VLAN_HLEN) which is 1514 >>> in x86. >>> >>> AFAICT, since mlx4 is doing one page per packet for XDP, >>> we can at least raise the MTU limitation up to >>> PAGE_SIZE - ETH_HLEN - (2 * VLAN_HLEN) which this patch is >>> doing. It will be useful in the next patch which allows >>> XDP program to extend the packet by adding new header(s). >>> >>> Signed-off-by: Martin KaFai Lau <ka...@fb.com> >>> --- >> >> >> Have you tested your patch on a host with PAGE_SIZE = 64 KB ? >> >> Looks XDP really kills arches with bigger pages :( > > > I'm afraid xdp mlx[45] support was not tested on arches > with 64k pages at all. Not just this patch.
Yep, in mlx5 page per packet became the default, with or without XDP, unlike mlx4. currently we allow 64KB pages per packet! which is wrong and need to be fixed. I will get to this task soon. > I think people who care about such archs should test? We do test mlx5 and mlx4 on PPC arch. other than we require more memory than we need, we don't see any issues. and we don't test XDP on those archs. > Note page per packet is not a hard requirement for all drivers > and all archs. For mlx[45] it was the easiest and the most > convenient way to achieve desired performance. > If there are ways to do the same performance differently, > I'm all ears :) > when bigger pages, i.e PAGE_SIZE > 8K, my current low hanging fruit options for mlx5 are 1. start sharing pages for multi packets. 2. Go back to the SKB allocator (allocate ring of SKBs on advance rather than page per packet/s). this means that default RX memory scheme will be different than XDP's on such ARCHs (XDP wil still use page per packet) Alexei, we should start considering PPC archs for XDP use cases, demanding page per packet on those archs is a little bit heavy requirement
