Re: [ovs-discuss] [ovs-dev] OVN Controller Incremental Processing

[Han Zhou]

On Thu, Jul 23, 2020 at 5:40 PM Tony Liu  wrote:
>
> Hi Han,
>
> Now, I have 4000 records in logical-switch table in nb-db, only 1567
records in datapath-binding
> table in sb-db. The translation was broken by a duplication (2 datapath
bindings point to the same
> logical-switch). Not sure how that happened. Anyways, I manually removed
this duplication.
> How can I trigger ovn-northd to finish the translation for all the rest
logical switches?
>
One thing you need to be aware of with many networks is that you probably
want to enable the option "ovn-monitor-all=true" on each HV node, to avoid
overloading the SB DB because of the big size of conditional monitoring
condition updates.

If you trigger any change to NB, ovn-northd will recompute everything. If
it doesn't complete the processing, there must be something wrong, and
there should be error logs.

>
> Thanks!
>
> Tony
>
> 
> From: Han Zhou 
> Sent: July 23, 2020 04:19 PM
> To: Tony Liu 
> Cc: Han Zhou ; ovs-dev ;
ovs-discuss 
> Subject: Re: [ovs-dev] OVN Controller Incremental Processing
>
>
>
> On Thu, Jul 23, 2020 at 4:12 PM  wrote:
> >
> > Thanks Han for the quick confirmation!
> > That says, when changes was made into nb-db, ovn-northd doesn't
recompile the whole db, instead, it only updates the increment into sb-db.
I am currently running some scaling test and seeing 100% CPU usage, hence
asking.
> >
> Oh, no. The talk was about "OVN-controller", which is the component
running on hypervisors, to translate SB data into OVS flows, and this has
been implemented (although not all scenarios are incrementally processed).
For ovn-northd, it runs on central node to convert data from NB to SB DB,
and it is not incremental yet with incremental processing, so it is
expected to see 100% CPU. There is currently a work ongoing for ovn-northd
incremental processing, with DDlog, by Ben and Leonid.
>
> > Tony
> >
> > On Jul 23, 2020 4:02 PM, Han Zhou  wrote:
> >
> >
> >
> > On Thu, Jul 23, 2020 at 11:17 AM Tony Liu 
wrote:
> > >
> > > Hi,
> > >
> > > Is this implemented and released?
> > >
https://www.slideshare.net/hanzhou1978/ovn-controller-incremental-processing
> > > Could anyone share an update on this?
> > >
> > >
> > > Thanks!
> > >
> > > Tony
> > >
> >
> > Yes, it was released initially in OVS/OVN 2.12 (if I remember
correctly), and there have been more improvements added gradually since
then.
> > (The "future" part which talks about DDlog is not implemented yet.)
> >
> > Thanks,
> > Han
> >
> >
___
discuss mailing list
disc...@openvswitch.org
https://mail.openvswitch.org/mailman/listinfo/ovs-discuss

Re: [ovs-discuss] [ovs-dev] OVN Controller Incremental Processing

[Tony Liu]

Hi Han,

Now, I have 4000 records in logical-switch table in nb-db, only 1567 records in 
datapath-binding
table in sb-db. The translation was broken by a duplication (2 datapath 
bindings point to the same
logical-switch). Not sure how that happened. Anyways, I manually removed this 
duplication.
How can I trigger ovn-northd to finish the translation for all the rest logical 
switches?


Thanks!

Tony


From: Han Zhou 
Sent: July 23, 2020 04:19 PM
To: Tony Liu 
Cc: Han Zhou ; ovs-dev ; ovs-discuss 

Subject: Re: [ovs-dev] OVN Controller Incremental Processing



On Thu, Jul 23, 2020 at 4:12 PM 
mailto:tonyliu0...@hotmail.com>> wrote:
>
> Thanks Han for the quick confirmation!
> That says, when changes was made into nb-db, ovn-northd doesn't recompile the 
> whole db, instead, it only updates the increment into sb-db. I am currently 
> running some scaling test and seeing 100% CPU usage, hence asking.
>
Oh, no. The talk was about "OVN-controller", which is the component running on 
hypervisors, to translate SB data into OVS flows, and this has been implemented 
(although not all scenarios are incrementally processed). For ovn-northd, it 
runs on central node to convert data from NB to SB DB, and it is not 
incremental yet with incremental processing, so it is expected to see 100% CPU. 
There is currently a work ongoing for ovn-northd incremental processing, with 
DDlog, by Ben and Leonid.

> Tony
>
> On Jul 23, 2020 4:02 PM, Han Zhou mailto:hz...@ovn.org>> wrote:
>
>
>
> On Thu, Jul 23, 2020 at 11:17 AM Tony Liu 
> mailto:tonyliu0...@hotmail.com>> wrote:
> >
> > Hi,
> >
> > Is this implemented and released?
> > https://www.slideshare.net/hanzhou1978/ovn-controller-incremental-processing
> > Could anyone share an update on this?
> >
> >
> > Thanks!
> >
> > Tony
> >
>
> Yes, it was released initially in OVS/OVN 2.12 (if I remember correctly), and 
> there have been more improvements added gradually since then.
> (The "future" part which talks about DDlog is not implemented yet.)
>
> Thanks,
> Han
>
>
___
discuss mailing list
disc...@openvswitch.org
https://mail.openvswitch.org/mailman/listinfo/ovs-discuss

Re: [ovs-discuss] [ovs-dev] OVN Controller Incremental Processing

[tonyliu0592]

Got it, thanks!TonyOn Jul 23, 2020 4:19 PM, Han Zhou  wrote:On Thu, Jul 23, 2020 at 4:12 PM  wrote:>> Thanks Han for the quick confirmation!> That says, when changes was made into nb-db, ovn-northd doesn't recompile the whole db, instead, it only updates the increment into sb-db. I am currently running some scaling test and seeing 100% CPU usage, hence asking.>Oh, no. The talk was about "OVN-controller", which is the component running on hypervisors, to translate SB data into OVS flows, and this has been implemented (although not all scenarios are incrementally processed). For ovn-northd, it runs on central node to convert data from NB to SB DB, and it is not incremental yet with incremental processing, so it is expected to see 100% CPU. There is currently a work ongoing for ovn-northd incremental processing, with DDlog, by Ben and Leonid.> Tony>> On Jul 23, 2020 4:02 PM, Han Zhou  wrote: On Thu, Jul 23, 2020 at 11:17 AM Tony Liu  wrote:> >> > Hi,> >> > Is this implemented and released?> > https://www.slideshare.net/hanzhou1978/ovn-controller-incremental-processing> > Could anyone share an update on this?> >> >> > Thanks!> >> > Tony> >>> Yes, it was released initially in OVS/OVN 2.12 (if I remember correctly), and there have been more improvements added gradually since then.> (The "future" part which talks about DDlog is not implemented yet.)>> Thanks,> Han>>
___
discuss mailing list
disc...@openvswitch.org
https://mail.openvswitch.org/mailman/listinfo/ovs-discuss

Re: [ovs-discuss] [ovs-dev] OVN Controller Incremental Processing

[Han Zhou]

On Thu, Jul 23, 2020 at 4:12 PM  wrote:
>
> Thanks Han for the quick confirmation!
> That says, when changes was made into nb-db, ovn-northd doesn't recompile
the whole db, instead, it only updates the increment into sb-db. I am
currently running some scaling test and seeing 100% CPU usage, hence asking.
>
Oh, no. The talk was about "OVN-controller", which is the component running
on hypervisors, to translate SB data into OVS flows, and this has been
implemented (although not all scenarios are incrementally processed). For
ovn-northd, it runs on central node to convert data from NB to SB DB, and
it is not incremental yet with incremental processing, so it is expected to
see 100% CPU. There is currently a work ongoing for ovn-northd incremental
processing, with DDlog, by Ben and Leonid.

> Tony
>
> On Jul 23, 2020 4:02 PM, Han Zhou  wrote:
>
>
>
> On Thu, Jul 23, 2020 at 11:17 AM Tony Liu  wrote:
> >
> > Hi,
> >
> > Is this implemented and released?
> >
https://www.slideshare.net/hanzhou1978/ovn-controller-incremental-processing
> > Could anyone share an update on this?
> >
> >
> > Thanks!
> >
> > Tony
> >
>
> Yes, it was released initially in OVS/OVN 2.12 (if I remember correctly),
and there have been more improvements added gradually since then.
> (The "future" part which talks about DDlog is not implemented yet.)
>
> Thanks,
> Han
>
>
___
discuss mailing list
disc...@openvswitch.org
https://mail.openvswitch.org/mailman/listinfo/ovs-discuss

Re: [ovs-discuss] [ovs-dev] OVN Controller Incremental Processing

[tonyliu0592]

Thanks Han for the quick confirmation!That says, when changes was made into nb-db, ovn-northd doesn't recompile the whole db, instead, it only updates the increment into sb-db. I am currently running some scaling test and seeing 100% CPU usage, hence asking.TonyOn Jul 23, 2020 4:02 PM, Han Zhou  wrote:On Thu, Jul 23, 2020 at 11:17 AM Tony Liu  wrote:>> Hi,>> Is this implemented and released?> https://www.slideshare.net/hanzhou1978/ovn-controller-incremental-processing> Could anyone share an update on this?>>> Thanks!>> Tony>Yes, it was released initially in OVS/OVN 2.12 (if I remember correctly), and there have been more improvements added gradually since then.(The "future" part which talks about DDlog is not implemented yet.)Thanks,Han
___
discuss mailing list
disc...@openvswitch.org
https://mail.openvswitch.org/mailman/listinfo/ovs-discuss

Re: [ovs-discuss] [ovs-dev] OVN Controller Incremental Processing

[Han Zhou]

On Thu, Jul 23, 2020 at 11:17 AM Tony Liu  wrote:
>
> Hi,
>
> Is this implemented and released?
>
https://www.slideshare.net/hanzhou1978/ovn-controller-incremental-processing
> Could anyone share an update on this?
>
>
> Thanks!
>
> Tony
>

Yes, it was released initially in OVS/OVN 2.12 (if I remember correctly),
and there have been more improvements added gradually since then.
(The "future" part which talks about DDlog is not implemented yet.)

Thanks,
Han
___
discuss mailing list
disc...@openvswitch.org
https://mail.openvswitch.org/mailman/listinfo/ovs-discuss