Re: [SR-Users] Releasing Kamailio v.5.4.9

Hello, preparing the release of v5.4.9 starts soon, therefore any commits to branch 5.4 have to be announced to sr-dev and wait for the ack before pushing to the git repo to avoid packaging conflicts. Cheers, Daniel On 14.09.22 14:17, Daniel-Constantin Mierla wrote: > Hello, > > I am planning to

Re: [SR-Users] Log levels severely impacts performance

> On Sep 15, 2022, at 10:54 PM, Amit wrote: > > I’ve already added the “-“ in front of the log file and that didn’t seem to > make any recognizable difference. That’s the only place that I know. Have you tested your storage throughput? Even something as simple as `hdparm -t /dev/sda`[1]? W

Re: [SR-Users] Log levels severely impacts performance

Hi Alex, Can you share specifically where in the configs I would be able to confirm that asynchronous logging is enabled? I’ve already added the “-“ in front of the log file and that didn’t seem to make any recognizable difference. Thanks in advance. Amit From: sr-users on behalf of Alex Balas

Re: [SR-Users] Log levels severely impacts performance

Jeremy, Thank you for sharing your experience. I did a little digging on multitool and only found the manpage, but not very much on how to install it. It doesn’t seem to be available via the yum package manager Would you mind sharing some info on installation and how you run it to capture stderr

Re: [SR-Users] Log levels severely impacts performance

Agree, have had some very high-volume systems with prodigious logging output for every call and no problems. Have also had these types of load problems on other systems with much less logging. The problem was either that asynchronous logging was not turned on, or the I/O subsystem was abnormal

Re: [SR-Users] Log levels severely impacts performance

Hello, Kamailio is using the system interface for syslog, this is also a code which is quite stable and has not seen a lot of changes in the last years. People are using Kamailio with a lot of logging in high load situation usually without problems, there has not been a lot of reports about that

Re: [SR-Users] Log levels severely impacts performance

On 9/13/2022 10:18 PM, Amit wrote: Does anyone have any experience with this or have any suggestions? We are finding it difficult to scale as a result of this issue. I was just dealing with this behavior. I was logging to a local rsyslog and rsyslog was just writing to a file on a local ssd (u

Re: [SR-Users] Kamailio stops processing requests mid script

In sngrep I do see the the INVITEs coming in, I’ll check more on the OS side and see what I can find. Again, thanks for checking! I’ll follow up with what I find. On Thu, Sep 15, 2022 at 09:16 Daniel-Constantin Mierla wrote: > Hello, > > if the traffic is over UDP, the Kamailio workers were blo

Re: [SR-Users] ndb_redis value substitution or escaping spaces

I see what you mean: if postprocessing the CSV is required, that sounds like a pain. Ideally there’s a way to unencode the column values as they’re streamed into pg_bulkupload somehow, even if it requires an additional programmatic shim. > On Sep 15, 2022, at 12:47 PM, Brooks Bridges wrote: >

Re: [SR-Users] ndb_redis value substitution or escaping spaces

I'm more concerned about the time and load involved in having to loop through a massive csv and run that against specific columns of each line. There may be an option to avoid having to do that though, I'll experiment with it a bit. Thanks for the suggestion! -Original Message- From:

Re: [SR-Users] ndb_redis value substitution or escaping spaces

base64 is a pretty trivial algorithm. You’d be surprised. > On Sep 15, 2022, at 12:37 PM, Brooks Bridges wrote: > > Unfortunately due to the volume of records, I don't think that's going to be > really feasible as I'm dumping these out directly to a csv to be archived and > imported into a dat

Re: [SR-Users] ndb_redis value substitution or escaping spaces

Unfortunately due to the volume of records, I don't think that's going to be really feasible as I'm dumping these out directly to a csv to be archived and imported into a database using pg_bulkload, and I don't think the additional overhead of having to process every record (of which there will

Re: [SR-Users] Log levels severely impacts performance

Then rework the logs. Do you have more than one log per registration? If yes, use only one. If you already have a single log per registration, then try reducing the size. Experiment to see where the system breaks. Try new hardware. Decrease the number of workers to see if it has an impact. -ovidiu

Re: [SR-Users] Kamailio stops processing requests mid script

Hello, if the traffic is over UDP, the Kamailio workers were blocked in recvfrom(), meaning that nothing is passed from the network layer to them. If you see UDP packets coming to Kamailio via ngrep/sngrep/..., then is the OS that drops them via firewall or some other app that controls the network

Re: [SR-Users] ndb_redis value substitution or escaping spaces

A common approach to avoid delimiter issues in general is to store base64-encoded strings in Redis rather than the original strings. If whatever is reading from Redis can un-encode them, that pretty well solves the problem. > On Sep 15, 2022, at 12:09 PM, Brooks Bridges wrote: > > I am aware o

[SR-Users] ndb_redis value substitution or escaping spaces

I am aware of, and have used sucessfully, the %s substitution option in redis_cmd, however when trying to do 4 values I'm getting a parse error about too many arguments. A review of the module's source appears to indicate that there is a hard limit of 3 substitution values when using this metho

Re: [SR-Users] Log levels severely impacts performance

Hi Henning, No we are using a local graylog server, not cloud. I suppose if the bottleneck is log generation, it doesn’t matter how or where they are handled/sent. Amit From: Henning Westerholt Date: Thursday, September 15, 2022 at 9:53 AM To: Amit Cc: Kamailio (SER) - Users Mailing List Subje

Re: [SR-Users] Kill child process created by app_python module

Hello Daniel, Probably, the process is not killed, because the child processes of the python module are not included in the kamailio children list. How can I register an event route in KEMI script? Doc

Re: [SR-Users] Log levels severely impacts performance

Hello Amit, this sounds strange. If you send them remotely it should not really affect the operation anymore. Maybe it’s a special limitation of the cloud server, if you use a public cloud service provider, but just guessing here. Cheers, Henning -- Henning Westerholt – https://skalatan.de/bl

Re: [SR-Users] Log levels severely impacts performance

Hi Henning, We are actually sending the logs directly to our local graylog server via the $programname property in rsyslog, and we’ve disabled writing Kamailio logs to disk (i.e. only in memory by setting Storage=volatile in rsyslog.conf) but that didn’t seem to help with the application socket

Re: [SR-Users] Log levels severely impacts performance

Hello, how much are you actually logging? As already suggested, maybe just need to decrease the amount of log messages. If you need this much logging, you can of course forward it to a dedicated log server over the network. Cheers, Henning -- Henning Westerholt – https://skalatan.de/blog/ Ka

Re: [SR-Users] SIPp uas(SIPp)->client reINVITE late offer

Check record route header that seems to be the issue.Le 15 sept. 2022 12:02, David Villasmil a écrit :Hello all,Anyone got a SIPp scenario for reINVITE with late offer? I.e.:UAT--->INVITE (sdp)--->SIPp UAT<--- 100 <---SIPp UAT<--- 183 <---SIPp UAT<--- 200 OK <---SIPp UAT> ACK --->SIPp UAT

Re: [SR-Users] Log levels severely impacts performance

Hi Henning, Thanks for the suggestion. Disk I/O was our initial assumption on another Kamilio instance we are running. To test this theory we installed Kamailio on separate hardware and configurations with faster underlying SSD disks, however we are seeing the same crippled performance and conges

[SR-Users] SIPp uas(SIPp)->client reINVITE late offer

Hello all, Anyone got a SIPp scenario for reINVITE with late offer? I.e.: UAT--->INVITE (sdp)--->SIPp UAT<--- 100 <---SIPp UAT<--- 183 <---SIPp UAT<--- 200 OK <---SIPp UAT> ACK --->SIPp UAT<--- INVITE (NO sdp) <---SIPp UAT---> 100 --->SIPp UAT---> 183 --->SIPp UAT---> 200 OK (sdp) -->SIPp UAT

Re: [SR-Users] Log levels severely impacts performance

Hello, additionally, try to see if you have some general I/O issues, e.g., by observing io-wait CPU, looking to I/O transaction times with monitoring tools etc.. Maybe there are other services also causing excessive I/O. Cheers, Henning -- Henning Westerholt – https://skalatan.de/blog/ Kamail

[SR-Users] New feature: #!ifexp - conditional preprocessor blocks

Hello, a new feature has landed to Kamailio devel version, bringing in more flexibility for preprocessing of the kamailio.cfg file. It is about #!ifexp, which allows to evaluate an expression created with defined IDs, string and number values. Based on evaluation result, being true or false, part

Re: [SR-Users] kamailio.org short unavailability

All should be back online. On 15.09.22 09:40, Daniel-Constantin Mierla wrote: > Hello, > > kamailio.org system needs a reboot and it will become unavailable for a > short time frame about 08:00UTC (20 min from now). Website, mailing > list, wiki, and a few other web services will be affected. > >

[SR-Users] kamailio.org short unavailability

Hello, kamailio.org system needs a reboot and it will become unavailable for a short time frame about 08:00UTC (20 min from now). Website, mailing list, wiki, and a few other web services will be affected. Cheers, Daniel -- Daniel-Constantin Mierla -- www.asipto.com www.twitter.com/miconda -- w

Re: [SR-Users] Kamailio stops processing requests mid script

It's actually metal, I've already asked for a different server so I can make sure hardware isn't the cause. On Wed, Sep 14, 2022 at 11:36 PM David Villasmil < david.villasmil.w...@gmail.com> wrote: > Is this metal or cloud? If aws try stopping/starting so it starts in a > different underlying h