Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-11 Thread O Mahony, Billy
..@openvswitch.org; Kevin Traynor > > Subject: RE: [ovs-dev] OVS DPDK NUMA pmd assignment question for > physical port > > Hi Billy, > > In my test, almost all traffic went trough via EMC. So the fix does not impact > the result, especially we want to know the difference (no

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-10 Thread 王志克
@openvswitch.org; Kevin Traynor Subject: RE: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port Hi Billy, > You are going to have to take the hit crossing the NUMA boundary at some > point if your NIC and VM are on different NUMAs. > > So are you saying that it is more

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-10 Thread 王志克
...@intel.com] Sent: Friday, September 08, 2017 11:18 PM To: 王志克; ovs-dev@openvswitch.org; Jan Scheurich; Darrell Ball; ovs-disc...@openvswitch.org; Kevin Traynor Subject: RE: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port Hi Wang, https://mail.openvswitch.org/pipermail/ovs-dev/2017

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-08 Thread O Mahony, Billy
克 [mailto:wangzh...@jd.com] > Sent: Friday, September 8, 2017 11:48 AM > To: ovs-dev@openvswitch.org; Jan Scheurich > ; O Mahony, Billy > ; Darrell Ball ; ovs- > disc...@openvswitch.org; Kevin Traynor > Subject: Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for > physical por

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-08 Thread 王志克
s-disc...@openvswitch.org" , "ovs-dev@openvswitch.org" , Kevin Traynor Subject: Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port Message-ID: <03135aea779d444e90975c2703f148dc58c19...@irsmsx107.ger.corp.intel.com> Cont

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-08 Thread O Mahony, Billy
Traynor Subject: RE: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port Hi All, I tested below cases, and get some performance data. The data shows there is little impact for cross NUMA communication, which is different from my expectation. (Previously I mentioned that cross NUMA

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-08 Thread 王志克
l Ball; ovs-disc...@openvswitch.org<mailto:ovs-disc...@openvswitch.org>; ovs-dev@openvswitch.org<mailto:ovs-dev@openvswitch.org>; Kevin Traynor Subject: RE: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port Hi Billy, > You are going to have to take the hit crossing th

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread 王志克
g > Subject: Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for > physical port > > On 09/06/2017 02:33 PM, Jan Scheurich wrote: > > Hi Billy, > > > >> You are going to have to take the hit crossing the NUMA boundary at > some point if your NIC and VM are o

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread 王志克
王志克 [mailto:wangzh...@jd.com] > Sent: Wednesday, September 6, 2017 12:50 PM > To: O Mahony, Billy ; Darrell Ball > ; ovs-disc...@openvswitch.org; ovs- > d...@openvswitch.org; Kevin Traynor > Subject: RE: [ovs-dev] OVS DPDK NUMA pmd assignment question for > physical port > >

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread O Mahony, Billy
: Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for > physical port > > On 09/06/2017 02:43 PM, Jan Scheurich wrote: > >> > >> I think the mention of pinning was confusing me a little. Let me see > >> if I fully understand your use case: You don't '

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread O Mahony, Billy
: Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for > physical port > > On 09/06/2017 02:33 PM, Jan Scheurich wrote: > > Hi Billy, > > > >> You are going to have to take the hit crossing the NUMA boundary at > some point if your NIC and VM are on different NUMAs.

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread Kevin Traynor
On 09/06/2017 02:43 PM, Jan Scheurich wrote: >> >> I think the mention of pinning was confusing me a little. Let me see if I >> fully understand your use case: You don't 'want' to pin >> anything but you are using it as a way to force the distribution of rxq from >> a single nic across to PMDs o

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread Kevin Traynor
On 09/06/2017 02:33 PM, Jan Scheurich wrote: > Hi Billy, > >> You are going to have to take the hit crossing the NUMA boundary at some >> point if your NIC and VM are on different NUMAs. >> >> So are you saying that it is more expensive to cross the NUMA boundary from >> the pmd to the VM that t

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread Jan Scheurich
> > I think the mention of pinning was confusing me a little. Let me see if I > fully understand your use case: You don't 'want' to pin > anything but you are using it as a way to force the distribution of rxq from > a single nic across to PMDs on different NUMAs. As without > pinning all rxqs

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread Jan Scheurich
Hi Billy, > You are going to have to take the hit crossing the NUMA boundary at some > point if your NIC and VM are on different NUMAs. > > So are you saying that it is more expensive to cross the NUMA boundary from > the pmd to the VM that to cross it from the NIC to the > PMD? Indeed, that i

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread O Mahony, Billy
: Wednesday, September 6, 2017 12:50 PM > To: O Mahony, Billy ; Darrell Ball > ; ovs-disc...@openvswitch.org; ovs- > d...@openvswitch.org; Kevin Traynor > Subject: RE: [ovs-dev] OVS DPDK NUMA pmd assignment question for > physical port > > Hi Billy, > > See my reply in lin

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread 王志克
Message- > From: 王志克 [mailto:wangzh...@jd.com] > Sent: Wednesday, September 6, 2017 11:41 AM > To: O Mahony, Billy ; Darrell Ball > ; ovs-disc...@openvswitch.org; ovs- > d...@openvswitch.org; Kevin Traynor > Subject: RE: [ovs-dev] OVS DPDK NUMA pmd assignment question for >

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread O Mahony, Billy
-Original Message- > > From: 王志克 [mailto:wangzh...@jd.com] > > Sent: Wednesday, September 6, 2017 10:20 AM > > To: O Mahony, Billy ; Darrell Ball > > ; ovs-disc...@openvswitch.org; ovs- > > d...@openvswitch.org; Kevin Traynor > > Subject: RE: [ovs-dev]

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread 王志克
ony, Billy [mailto:billy.o.mah...@intel.com] Sent: Wednesday, September 06, 2017 6:35 PM To: 王志克; Darrell Ball; ovs-disc...@openvswitch.org; ovs-dev@openvswitch.org; Kevin Traynor Subject: RE: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port Hi Wang, If you create several PMDs on the N

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread O Mahony, Billy
> ; ovs-disc...@openvswitch.org; ovs- > d...@openvswitch.org; Kevin Traynor > Subject: RE: [ovs-dev] OVS DPDK NUMA pmd assignment question for > physical port > > Hi Billy, > > Yes, I want to achieve better performance. > > The commit "dpif-netdev: Assign ports

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread Kevin Traynor
tember 06, 2017 1:39 PM > To: 王志克; ovs-disc...@openvswitch.org; ovs-dev@openvswitch.org > Subject: Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port > > You could use pmd-rxq-affinity for the queues you want serviced locally and > let the othe

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread 王志克
Wednesday, September 06, 2017 5:14 PM To: Darrell Ball; 王志克; ovs-disc...@openvswitch.org; ovs-dev@openvswitch.org; Kevin Traynor Subject: RE: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port Hi Wang, A change was committed to head of master 2017-08-02 "dpif-netdev: Assign ports

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread O Mahony, Billy
isc...@openvswitch.org; ovs- > d...@openvswitch.org; O Mahony, Billy ; Kevin > Traynor > Subject: Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for > physical port > > Adding Billy and Kevin > > > On 9/6/17, 12:22 AM, "Darrell Ball" wrote: >

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread Darrell Ball
Adding Billy and Kevin On 9/6/17, 12:22 AM, "Darrell Ball" wrote: On 9/6/17, 12:03 AM, "王志克" wrote: Hi Darrell, pmd-rxq-affinity has below limitation: (so isolated pmd can not be used for others, which is not my expectation. Lots of VMs come and go

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread Darrell Ball
On 9/6/17, 12:03 AM, "王志克" wrote: Hi Darrell, pmd-rxq-affinity has below limitation: (so isolated pmd can not be used for others, which is not my expectation. Lots of VMs come and go on the fly, and manully assignment is not feasible.) >>After that PMD threads on co

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-06 Thread 王志克
l Ball [mailto:db...@vmware.com] Sent: Wednesday, September 06, 2017 1:39 PM To: 王志克; ovs-disc...@openvswitch.org; ovs-dev@openvswitch.org Subject: Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port You could use pmd-rxq-affinity for the queues you want serviced locally and let the oth

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-05 Thread Darrell Ball
To: 王志克; ovs-disc...@openvswitch.org; ovs-dev@openvswitch.org Subject: Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port This same numa node limitation was already removed, although same numa is preferred for performance reasons.

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-05 Thread 王志克
...@vmware.com] Sent: Wednesday, September 06, 2017 10:47 AM To: 王志克; ovs-disc...@openvswitch.org; ovs-dev@openvswitch.org Subject: Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port This same numa node limitation was already removed, although same numa is preferred for performance

Re: [ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-05 Thread Darrell Ball
This same numa node limitation was already removed, although same numa is preferred for performance reasons. commit c37813fdb030b4270d05ad61943754f67021a50d Author: Billy O'Mahony Date: Tue Aug 1 14:38:43 2017 -0700 dpif-netdev: Assign ports to pmds on non-local numa node. Previo

[ovs-dev] OVS DPDK NUMA pmd assignment question for physical port

2017-09-05 Thread 王志克
Hi All, I read below doc about pmd assignment for physical port. I think the limitation “on the same NUMA node” may be not efficient. http://docs.openvswitch.org/en/latest/intro/install/dpdk/ DPDK Physical Port Rx Queues¶