Hello, Ilya It`s great news, thank you a lot! Regarding testing - I am not sure, we are using OVS in containers, prepared by openstack kola team. I will try to build OVS from source in proper way, to test the patch, and give you feedback.
Thank you. -----Original Message----- From: Ilya Maximets <i.maxim...@ovn.org> Sent: Saturday, August 20, 2022 2:12 AM To: Oleksandr Mykhalskyi <oleksandr.mykhals...@netcracker.com> Cc: i.maxim...@ovn.org; ovs-discuss@openvswitch.org; Dan Williams <d...@redhat.com>; Terry Wilson <twil...@redhat.com> Subject: Re: [ovs-discuss] Unreasonably often OVS DB compaction [External Email] ________________________________ On 8/18/22 11:44, Oleksandr Mykhalskyi wrote: > Good day, Ilya > > Here are part of logs from one of cloud controllers with OVN databases (OVS > version 2.15.2): > > 2022-07-31T06:43:34.501Z|22618|raft|INFO|Transferring leadership to write a > snapshot. > 2022-07-31T06:43:40.344Z|22620|ovsdb|INFO|OVN_Southbound: Database > compaction took 5178ms > 2022-07-31T06:53:30.735Z|22823|raft|INFO|received leadership transfer from > 3d60 in term 7198 2022-07-31T06:57:39.616Z|23004|raft|INFO|Transferring > leadership to write a snapshot. > 2022-07-31T06:57:43.860Z|23007|ovsdb|INFO|OVN_Southbound: Database > compaction took 4210ms > 2022-07-31T07:12:02.552Z|23065|raft|INFO|received leadership transfer from > 3d60 in term 7200 2022-07-31T07:12:20.060Z|23076|raft|INFO|Transferring > leadership to write a snapshot. > 2022-07-31T07:12:27.262Z|23097|ovsdb|INFO|OVN_Southbound: Database > compaction took 4003ms > 2022-07-31T07:24:29.820Z|23162|raft|INFO|received leadership transfer from > 3d60 in term 7202 2022-07-31T07:32:25.125Z|23382|raft|INFO|Transferring > leadership to write a snapshot. > 2022-07-31T07:32:29.196Z|23384|ovsdb|INFO|OVN_Southbound: Database > compaction took 4044ms > 2022-07-31T07:37:03.280Z|23406|raft|INFO|received leadership transfer from > 3d60 in term 7204 2022-07-31T07:46:00.005Z|23636|raft|INFO|Transferring > leadership to write a snapshot. > 2022-07-31T07:46:03.997Z|23638|ovsdb|INFO|OVN_Southbound: Database > compaction took 3972ms > 2022-07-31T07:48:39.696Z|23655|raft|INFO|received leadership transfer from > 3d60 in term 7206 2022-07-31T07:59:23.896Z|23866|raft|INFO|Transferring > leadership to write a snapshot. > 2022-07-31T07:59:28.056Z|23869|ovsdb|INFO|OVN_Southbound: Database > compaction took 4134ms > 2022-07-31T08:07:04.581Z|23976|raft|INFO|received leadership transfer from > 3d60 in term 7208 2022-07-31T08:18:58.858Z|24220|raft|INFO|Transferring > leadership to write a snapshot. > 2022-07-31T08:19:02.964Z|24222|ovsdb|INFO|OVN_Southbound: Database > compaction took 4070ms > 2022-07-31T08:19:21.872Z|24276|raft|INFO|received leadership transfer from > 3d60 in term 7210 2022-07-31T08:37:12.292Z|24579|raft|INFO|Transferring > leadership to write a snapshot. > 2022-07-31T08:37:16.214Z|24581|ovsdb|INFO|OVN_Southbound: Database > compaction took 3899ms > 2022-07-31T08:37:37.502Z|24598|raft|INFO|received leadership transfer from > 3d60 in term 7212 2022-07-31T08:47:55.412Z|24791|raft|INFO|Transferring > leadership to write a snapshot. > 2022-07-31T08:47:59.465Z|24793|ovsdb|INFO|OVN_Southbound: Database > compaction took 4033ms > > Just after compaction, DB size is 105Mb, after that DB grows to 106-107Mb in > 10-20min, and we have compaction again. > > Full story: > 2022-07-30 06:43 - I updated cloud and restarted OVN SB DB cluster. There > were no compactions during that day. > 2022-07-31 06:43 - DB triggered first compaction after reboot and then > started to do it each 10-20min. > 2022-07-31 17:00 - I restarted DB cluster again. > 2022-08-01 15:00 - DB triggered first compaction after reboot, when DB size > was 210MB, and started to do compaction again, each 10-20min. Thanks! I think, I found a 'typo' that caused the issue. Posted a fix here: https://patchwork.ozlabs.org/project/openvswitch/patch/20220819230810.2626573-1-i.maxim...@ovn.org/ Would be great if you can test it out. Best regards, Ilya Maximets. > > Thank you. > > Oleksandr Mykhalskyi, System Engineer, IT Servers and Services, LAUT > Netcracker Technology > > +38 (044) 238-8727 ext 6404 | office > > > -----Original Message----- > From: Ilya Maximets <i.maxim...@ovn.org> > Sent: Wednesday, August 17, 2022 3:46 PM > To: Oleksandr Mykhalskyi <oleksandr.mykhals...@netcracker.com> > Cc: i.maxim...@ovn.org; ovs-discuss@openvswitch.org; Dan Williams > <d...@redhat.com>; Terry Wilson <twil...@redhat.com> > Subject: Re: [ovs-discuss] Unreasonably often OVS DB compaction > > [External Email] > ________________________________ > > > >> Terry, thank you for update. >> I will check if openstack xena or yoga uses OVS 2.17 >> >> Meanwhile, my main concern - why OVS DB triggers compaction every 10-20min >> regardless of conditions, described in >> http://www.openvswitch.org/support/dist-docs/ovsdb-server.1.txt? >> For our case, with OVN DB DB size 105Mb (after first compaction), I am >> expecting to have next compaction after reaching DB size 210Mb, but not >> after 106-107Mb. > > > Hi, Oleksandr. > > That doesn't sound right indeed. I've never seen that behavior and I'm not > sure how that can happen. > > How do you detect that DB is compacting? Are you looking for a message > regarding a leadership transfer or, maybe, reports about time it took to > compact? If you can provide some parts of ovsdb-server logs, that might also > be useful. > > Best regards, Ilya Maximets. > > > ________________________________ > The information transmitted herein is intended only for the person or entity > to which it is addressed and may contain confidential, proprietary and/or > privileged material. Any review, retransmission, dissemination or other use > of, or taking of any action in reliance upon, this information by persons or > entities other than the intended recipient is prohibited. If you received > this in error, please contact the sender and delete the material from any > computer. ________________________________ The information transmitted herein is intended only for the person or entity to which it is addressed and may contain confidential, proprietary and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. _______________________________________________ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
