Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-07-01 Thread Ben Pfaff
On Thu, Jul 01, 2021 at 12:18:12AM -0700, Ben Pfaff wrote: > On Tue, Jun 29, 2021 at 03:32:26PM -0700, Ben Pfaff wrote: > > On Mon, Jun 28, 2021 at 05:40:53PM +0200, Dumitru Ceara wrote: > > > On 5/20/21 5:50 PM, Ben Pfaff wrote: > > > > On Thu, May 20, 2021 at 05:06:26PM +0200, Dumitru Ceara wrote

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-07-01 Thread Numan Siddique
On Thu, Jul 1, 2021 at 4:31 AM Dumitru Ceara wrote: > > On 7/1/21 9:18 AM, Ben Pfaff wrote: > > On Tue, Jun 29, 2021 at 03:32:26PM -0700, Ben Pfaff wrote: > >> On Mon, Jun 28, 2021 at 05:40:53PM +0200, Dumitru Ceara wrote: > >>> On 5/20/21 5:50 PM, Ben Pfaff wrote: > On Thu, May 20, 2021 at 0

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-07-01 Thread Dumitru Ceara
On 7/1/21 9:18 AM, Ben Pfaff wrote: > On Tue, Jun 29, 2021 at 03:32:26PM -0700, Ben Pfaff wrote: >> On Mon, Jun 28, 2021 at 05:40:53PM +0200, Dumitru Ceara wrote: >>> On 5/20/21 5:50 PM, Ben Pfaff wrote: On Thu, May 20, 2021 at 05:06:26PM +0200, Dumitru Ceara wrote: > On 4/7/21 6:49 PM, Be

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-07-01 Thread Ben Pfaff
On Tue, Jun 29, 2021 at 03:32:26PM -0700, Ben Pfaff wrote: > On Mon, Jun 28, 2021 at 05:40:53PM +0200, Dumitru Ceara wrote: > > On 5/20/21 5:50 PM, Ben Pfaff wrote: > > > On Thu, May 20, 2021 at 05:06:26PM +0200, Dumitru Ceara wrote: > > >> On 4/7/21 6:49 PM, Ben Pfaff wrote: > > >> > > >> [...] >

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-06-29 Thread Ben Pfaff
On Mon, Jun 28, 2021 at 05:40:53PM +0200, Dumitru Ceara wrote: > On 5/20/21 5:50 PM, Ben Pfaff wrote: > > On Thu, May 20, 2021 at 05:06:26PM +0200, Dumitru Ceara wrote: > >> On 4/7/21 6:49 PM, Ben Pfaff wrote: > >> > >> [...] > >> > > Thanks! I can download them now. It's back on my to-

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-06-28 Thread Dumitru Ceara
On 5/20/21 5:50 PM, Ben Pfaff wrote: > On Thu, May 20, 2021 at 05:06:26PM +0200, Dumitru Ceara wrote: >> On 4/7/21 6:49 PM, Ben Pfaff wrote: >> >> [...] >> Thanks! I can download them now. It's back on my to-do list. >>> >>> I can reproduce the problem now. I haven't fixed it yet, but

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-05-20 Thread Ben Pfaff
On Thu, May 20, 2021 at 05:06:26PM +0200, Dumitru Ceara wrote: > On 4/7/21 6:49 PM, Ben Pfaff wrote: > > [...] > > >> > >> Thanks! I can download them now. It's back on my to-do list. > > > > I can reproduce the problem now. I haven't fixed it yet, but I did fix > > a nasty performance proble

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-05-20 Thread Dumitru Ceara
On 4/7/21 6:49 PM, Ben Pfaff wrote: [...] >> >> Thanks! I can download them now. It's back on my to-do list. > > I can reproduce the problem now. I haven't fixed it yet, but I did fix > a nasty performance problem in ovn-nbctl that became really apparent > when working with your databases: >

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-04-07 Thread Ben Pfaff
On Thu, Apr 01, 2021 at 09:54:10AM -0700, Ben Pfaff wrote: > On Thu, Apr 01, 2021 at 06:33:21PM +0200, Dumitru Ceara wrote: > > On 4/1/21 5:48 PM, Ben Pfaff wrote: > > > On Wed, Mar 24, 2021 at 04:03:07PM +0100, Dumitru Ceara wrote: > > >> Hi Ben, > > >> > > >> We discussed a bit about this during

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-04-01 Thread Ben Pfaff
On Thu, Apr 01, 2021 at 06:33:21PM +0200, Dumitru Ceara wrote: > On 4/1/21 5:48 PM, Ben Pfaff wrote: > > On Wed, Mar 24, 2021 at 04:03:07PM +0100, Dumitru Ceara wrote: > >> Hi Ben, > >> > >> We discussed a bit about this during one of the recent IRC OVN meetings, > >> but I didn't get around to pro

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-04-01 Thread Dumitru Ceara
On 4/1/21 5:48 PM, Ben Pfaff wrote: > On Wed, Mar 24, 2021 at 04:03:07PM +0100, Dumitru Ceara wrote: >> Hi Ben, >> >> We discussed a bit about this during one of the recent IRC OVN meetings, >> but I didn't get around to properly reporting this until now. >> >> I've tried running ovn-northd-ddlog a

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-04-01 Thread Ben Pfaff
On Wed, Mar 24, 2021 at 04:03:07PM +0100, Dumitru Ceara wrote: > Hi Ben, > > We discussed a bit about this during one of the recent IRC OVN meetings, > but I didn't get around to properly reporting this until now. > > I've tried running ovn-northd-ddlog against some large OVN NB/DB > databases ex

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-03-31 Thread Ben Pfaff
I found the leaks and the fixes will be in v2 of the series. On Thu, Mar 25, 2021 at 01:14:37PM -0700, Ben Pfaff wrote: > OK. I guess I'll have to try it myself. > > On Thu, Mar 25, 2021 at 12:59:00PM +0530, Numan Siddique wrote: > > Hi Ben, > > > > With your memory fixes applied, I still see m

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-03-25 Thread Ben Pfaff
OK. I guess I'll have to try it myself. On Thu, Mar 25, 2021 at 12:59:00PM +0530, Numan Siddique wrote: > Hi Ben, > > With your memory fixes applied, I still see many test failures due to > memory leaks > when configured as: > > ./configure --enable-Werror --enable-sparse CFLAGS="-g -fsanitize=

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-03-25 Thread Numan Siddique
Hi Ben, With your memory fixes applied, I still see many test failures due to memory leaks when configured as: ./configure --enable-Werror --enable-sparse CFLAGS="-g -fsanitize=address" You can find more details about the memory leaks here - https://gist.github.com/numansiddique/e701777da977a89e

Re: [ovs-dev] ovn-northd-ddlog scale issues

2021-03-24 Thread Ben Pfaff
Thanks a lot for the report! I need a new test case so I'll give this one a shot when I can. On Wed, Mar 24, 2021 at 04:03:07PM +0100, Dumitru Ceara wrote: > Hi Ben, > > We discussed a bit about this during one of the recent IRC OVN meetings, > but I didn't get around to properly reporting this

[ovs-dev] ovn-northd-ddlog scale issues

2021-03-24 Thread Dumitru Ceara
Hi Ben, We discussed a bit about this during one of the recent IRC OVN meetings, but I didn't get around to properly reporting this until now. I've tried running ovn-northd-ddlog against some large OVN NB/DB databases extracted from one of our scale testing runs: http://people.redhat.com/~dceara