Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-03-24 Thread Kevin Traynor
Hi Anurag, On 16/03/2022 12:29, Anurag Agarwal wrote: Hello Kevin, Thanks for your inputs. In this scenario we have one VM each on NUMA0 and NUMA1 (VM1 is on NUMA0, VM2 is on NUMA1), dpdk port is on NUMA1. Without cross-numa-polling, VM/VHU queue traffic is evenly distributed based on

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-03-16 Thread Anurag Agarwal via dev
Hello Kevin, Thanks for your inputs. In this scenario we have one VM each on NUMA0 and NUMA1 (VM1 is on NUMA0, VM2 is on NUMA1), dpdk port is on NUMA1. Without cross-numa-polling, VM/VHU queue traffic is evenly distributed based on load on their respective NUMA sockets. However, DPDK

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-03-10 Thread Kevin Traynor
On 04/03/2022 17:57, Anurag Agarwal wrote: Hello Kevin, I have prepared a patch for "per port cross-numa-polling" and attached herewith. The results are captured in 'cross-numa-results.txt'. We see PMD to RxQ assignment evenly balanced across all PMDs with this patch. Please take

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-03-10 Thread Kevin Traynor
Hi Jan, On 09/03/2022 15:48, Jan Scheurich wrote: Thanks for sharing your experience with it. My fear with the proposal is that someone turns this on and then tells us performance is worse and/or OVS assignments/ALB are broken, because it has an impact on their case. In terms of limiting possib

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-03-09 Thread Jan Scheurich via dev
> Thanks for sharing your experience with it. My fear with the proposal is that > someone turns this on and then tells us performance is worse and/or OVS > assignments/ALB are broken, because it has an impact on their case. > > In terms of limiting possible negative effects, > - it can be opt-in a

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-03-04 Thread Anurag Agarwal via dev
Hello Kevin, I have prepared a patch for "per port cross-numa-polling" and attached herewith. The results are captured in 'cross-numa-results.txt'. We see PMD to RxQ assignment evenly balanced across all PMDs with this patch. Please take a look and let us know your inputs. Please

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-02-24 Thread Kevin Traynor
Hi Jan, On 17/02/2022 14:21, Jan Scheurich wrote: Hi Kevin, We have done extensive benchmarking and found that we get better overall PMD load balance and resulting OVS performance when we do not statically pin any rx queues and instead let the auto-load-balancing find the optimal distribution

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-02-17 Thread Jan Scheurich via dev
Hi Kevin, > > We have done extensive benchmarking and found that we get better overall > PMD load balance and resulting OVS performance when we do not statically > pin any rx queues and instead let the auto-load-balancing find the optimal > distribution of phy rx queues over both NUMA nodes to bal

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-02-17 Thread Kevin Traynor
Hi Jan, On 14/02/2022 10:54, Jan Scheurich wrote: We do acknowledge the benefit of non-pinned polling of phy rx queues by PMD threads on all NUMA nodes. It gives the auto-load balancer much better options to utilize spare capacity on PMDs on all NUMA nodes. Our patch proposed in https://prote

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-02-14 Thread Wan Junjie
On Mon, Feb 14, 2022 at 6:54 PM Jan Scheurich wrote: > > > > We do acknowledge the benefit of non-pinned polling of phy rx queues by > > PMD threads on all NUMA nodes. It gives the auto-load balancer much better > > options to utilize spare capacity on PMDs on all NUMA nodes. > > > > > > Our patch

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-02-14 Thread Jan Scheurich via dev
> > We do acknowledge the benefit of non-pinned polling of phy rx queues by > PMD threads on all NUMA nodes. It gives the auto-load balancer much better > options to utilize spare capacity on PMDs on all NUMA nodes. > > > > Our patch proposed in > > https://protect2.fireeye.com/v1/url?k=31323334-50

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-02-14 Thread Wan Junjie
On Mon, Feb 14, 2022 at 6:12 PM Jan Scheurich wrote: > > > > > > > Btw, this patch is similar in functionality to the one posted by > > > Anurag [0] and there was also some discussion about this approach here > > > [1]. > > > > > > > Thanks for pointing this out. > > IMO, setting interface cross-

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-02-14 Thread Jan Scheurich via dev
> > > > Btw, this patch is similar in functionality to the one posted by > > Anurag [0] and there was also some discussion about this approach here [1]. > > > > Thanks for pointing this out. > IMO, setting interface cross-numa would be good for phy port but not good for > vhu. Since vhu can be de

Re: [ovs-dev] [External] Re: [PATCH] dpif-netdev: add an option to assign pmd rxq to all numas

2022-02-12 Thread Wan Junjie
Hi Kevin, Thanks for your reply. Sorry about forgetting the cc, repost it. On Sat, Feb 12, 2022 at 1:09 AM Kevin Traynor wrote: > > Hi Wan Junjie, > > On 27/01/2022 11:43, Wan Junjie wrote: > > When assign a rxq to a pmd, the rxq will only be assigned to > > the numa it belongs. An exception is