Another tip for you… You’ll be tempted to crank up the fetch_rows to try to get it to load faster, but I’ve found that increasing that above 5k-ish doesn’t really seem to speed anything up and sometimes causes it to run a bit slower when importing the larger datasets. Obviously there are a lot of factors that go into that, but with a decently specced DB server and Kam server, once I started getting above 5k it did start slowing down again.
Brooks Bridges 1200 S. Rogers Circle, Unit 6 Boca Raton, FL 33487 Office: 916-235-2097 Main: 888-444-1111 email: [email protected]<mailto:[email protected]> | web: www.call48.com<http://www.call48.com/> [cid:[email protected]] From: sr-users <[email protected]> On Behalf Of David Villasmil Sent: Thursday, April 7, 2022 09:34 To: Kamailio (SER) - Users Mailing List <[email protected]> Subject: Re: [SR-Users] Htable reload Thanks Brooks, that's great news! Regards, David Villasmil email: [email protected]<mailto:[email protected]> phone: +34669448337 On Thu, Apr 7, 2022 at 4:20 PM Brooks Bridges <[email protected]<mailto:[email protected]>> wrote: I have several htables with various amounts of data in them ranging from a couple hundred entries to a couple million entries and while the reload itself does take a bit, the vast majority of the delay is the database -> Kamailio loading time. Once the data is in there, the pointer updates haven’t been anything I’ve noticed. I’m sure it takes some measurable amount of time, but in my case it’s so imperceptible that it’s irrelevant. Brooks Bridges 1200 S. Rogers Circle, Unit 6 Boca Raton, FL 33487 Office: 916-235-2097 Main: 888-444-1111 email: [email protected]<mailto:[email protected]> | web: www.call48.com<http://www.call48.com/> [cid:[email protected]] From: sr-users <[email protected]<mailto:[email protected]>> On Behalf Of David Villasmil Sent: Thursday, April 7, 2022 08:09 To: Kamailio (SER) - Users Mailing List <[email protected]<mailto:[email protected]>> Subject: Re: [SR-Users] Htable reload Thanks Alex, I'm wondering how this will affect performance if there are many thousands or even millions of records... Regards, David Villasmil email: [email protected]<mailto:[email protected]> phone: +34669448337 On Thu, Apr 7, 2022 at 4:03 PM Alex Balashov <[email protected]<mailto:[email protected]>> wrote: No, the reload actually creates a temporary new hash table (in heap), loads the entries from the DB into it, then iterates through the buckets of that temporary table and replaces the entries (pointers) in the existing table with the entries from the temporary table, then frees the buckets in the temporary table. > On Apr 7, 2022, at 4:43 AM, David Villasmil > <[email protected]<mailto:[email protected]>> wrote: > > Hello all, > > I’ve been trying to figure out how htable reloads happen. Does it replaces > the existing one or creates a new one, populates it from the db and then > renames it? The latter would be (I think) ideal, even if it uses more > resources. > > Thanks! > > David > -- > Regards, > > David Villasmil > email: [email protected]<mailto:[email protected]> > phone: +34669448337 > __________________________________________________________ > Kamailio - Users Mailing List - Non Commercial Discussions > * [email protected]<mailto:[email protected]> > Important: keep the mailing list in the recipients, do not reply only to the > sender! > Edit mailing list options or unsubscribe: > * https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users -- Alex Balashov | Principal | Evariste Systems LLC Tel: +1-706-510-6800 / +1-800-250-5920 (toll-free) Web: http://www.evaristesys.com/, http://www.csrpswitch.com/ __________________________________________________________ Kamailio - Users Mailing List - Non Commercial Discussions * [email protected]<mailto:[email protected]> Important: keep the mailing list in the recipients, do not reply only to the sender! Edit mailing list options or unsubscribe: * https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users Confidentiality Notice: This e-mail, and any attachment to it, contains privileged and confidential information intended only for the use of the individual(s) or entity named on the e-mail. If the reader of this e-mail is not the intended recipient, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that reading this e-mail is strictly prohibited. If you have received this e-mail in error, please immediately return it to the sender and delete it from your system. __________________________________________________________ Kamailio - Users Mailing List - Non Commercial Discussions * [email protected]<mailto:[email protected]> Important: keep the mailing list in the recipients, do not reply only to the sender! Edit mailing list options or unsubscribe: * https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users Confidentiality Notice: This e-mail, and any attachment to it, contains privileged and confidential information intended only for the use of the individual(s) or entity named on the e-mail. If the reader of this e-mail is not the intended recipient, or the employee or agent responsible for delivering it to the intended recipient, you are hereby notified that reading this e-mail is strictly prohibited. If you have received this e-mail in error, please immediately return it to the sender and delete it from your system.
__________________________________________________________ Kamailio - Users Mailing List - Non Commercial Discussions * [email protected] Important: keep the mailing list in the recipients, do not reply only to the sender! Edit mailing list options or unsubscribe: * https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
