Re: [SR-Users] Kamailio LCR module memory concern

2015-06-11 Thread Alex Balashov
Why would you go through the trouble of encapsulating that in some sort of presence layer? Just query Redis directly with redis_cmd() from the ndb_redis module. Whether you need an SQL database or can get by with Redis is a complex topic. It's ultimately a question of how complicated a feature

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-11 Thread Abdul Hakeem
? Cheers, Abdul Hakeem -Original Message- From: sr-users [mailto:sr-users-boun...@lists.sip-router.org] On Behalf Of Daniel-Constantin Mierla Sent: Thursday, June 11, 2015 12:11 PM To: Kamailio (SER) - Users Mailing List Subject: Re: [SR-Users] Kamailio LCR module memory concern Hello, you can

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-11 Thread Daniel-Constantin Mierla
, June 10, 2015 9:41 PM > To: sr-users@lists.sip-router.org > Subject: Re: [SR-Users] Kamailio LCR module memory concern > > On 06/10/2015 04:30 PM, Ali Taher wrote: > >> How did your customer handle 137 million using kamailio lcr? > I suppose I should clarify; they did not

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 05:13 PM, Abdul Hakeem wrote: What do you recommend for such giant 137 million routes or entries ? The same that anyone would recommend for any application that aims to store 137 million rows of anything: a relational database, queried manually from Kamailio route script using

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Abdul Hakeem
: Re: [SR-Users] Kamailio LCR module memory concern On 06/10/2015 04:30 PM, Ali Taher wrote: > How did your customer handle 137 million using kamailio lcr? I suppose I should clarify; they did not use Kamailio's lcr module. As I said earlier, I don't think the Kamailio lcr module i

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
Thanks Alex you saved my life! will check and try to implement this module Ali Sent from my iPhone > On Jun 10, 2015, at 10:55 PM, Alex Balashov wrote: > >> On 06/10/2015 03:53 PM, Ali Taher wrote: >> >> Can I configure kamailio to read directly from the database without >> setting them in the

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 04:30 PM, Ali Taher wrote: How did your customer handle 137 million using kamailio lcr? I suppose I should clarify; they did not use Kamailio's lcr module. As I said earlier, I don't think the Kamailio lcr module is appropriate for such a case. -- Alex Balashov | Principal

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 04:30 PM, Ali Taher wrote: How did your customer handle 137 million using kamailio lcr? Database query to PostgreSQL. -- Alex Balashov | Principal | Evariste Systems LLC 303 Perimeter Center North, Suite 300 Atlanta, GA 30346 United States Tel: +1-800-250-5920 (toll-free) / +

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
The case mentioned is exactly our case where we deal with class 4, wholesale carriers with many vendors; just as explained in the provided short duration dialer video where we are using Kamailio lcr as redirect server. Hence, what can we do in order to afford such Huge number of rules? How did

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 03:53 PM, Ali Taher wrote: Can I configure kamailio to read directly from the database without setting them in the memory? Sure... http://kamailio.org/docs/modules/4.3.x/modules/sqlops.html -- Alex Balashov | Principal | Evariste Systems LLC 303 Perimeter Center North, Suite 30

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
Hi Alex, What do you mean by "consider an LCR approach that does not rely on having the entire data set in memory, but instead utilises an efficient, lightweight, but still database-bound query approach." Can I configure kamailio to read directly from the database without setting them in the m

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 12:52 PM, Juha Heinanen wrote: i wonder how it is possible to have so many distinct e.164 prefixes for transit unless you need to deal with individual subscriber numbers. It's quite possible for folks who run dialler traffic[1], at least in the US. The reasons are: - Most rate

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Juha Heinanen
Ali Taher writes: > This is the number of rules generated from our system for LCR routing > (we are dealing with transit traffic). i wonder how it is possible to have so many distinct e.164 prefixes for transit unless you need to deal with individual subscriber numbers. if you deal with subscrib

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 12:44 PM, Ali Taher wrote: This is the number of rules generated from our system for LCR routing (we are dealing with transit traffic) Indeed, but if you have a system of that size and complexity, I would encourage you to consider an LCR approach that does not rely on having th

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
This is the number of rules generated from our system for LCR routing (we are dealing with transit traffic) Ali Sent from my iPhone > On Jun 10, 2015, at 7:10 PM, Alex Balashov wrote: > >> On 06/10/2015 12:00 PM, Ali Taher wrote: >> >> So what memory should be allocated to handle 67m buckets

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 12:00 PM, Ali Taher wrote: So what memory should be allocated to handle 67m buckets ? A better question would be: why do you want to store 44m rules in memory? That's a lot of rules. -- Alex Balashov | Principal | Evariste Systems LLC 303 Perimeter Center North, Suite 300 Atla

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 12:00 PM, Ali Taher wrote: Is there any documentation for hash tables for kamailio? http://en.wikipedia.org/wiki/Hash_table -- Alex Balashov | Principal | Evariste Systems LLC 303 Perimeter Center North, Suite 300 Atlanta, GA 30346 United States Tel: +1-800-250-5920 (toll-free)

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
Thanks Alex, So what memory should be allocated to handle 67m buckets ? Is there any documentation for hash tables for kamailio? Ali Sent from my iPhone > On Jun 10, 2015, at 6:52 PM, Alex Balashov wrote: > >> On 06/10/2015 11:48 AM, Ali Taher wrote: >> >> Hi Alex, >> >> I don't know a lot

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 11:48 AM, Ali Taher wrote: Hi Alex, I don't know a lot about hash tables , and how hash buckets and memory are related. I just need to know the specs needed for a server in order to be able to handle 44 million or rules using LCR module , and what configuration (parameters) should

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Juha Heinanen
Ali Taher writes: > I just need to know the specs needed for a server in order to be able to > handle 44 million or rules using LCR module , and what configuration > (parameters) should be applied. I have already answered this. Calculate from lcr_mod.h rule_info struct how much memory one rule r

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
ginal Message- From: sr-users [mailto:sr-users-boun...@lists.sip-router.org] On Behalf Of Alex Balashov Sent: Wednesday, June 10, 2015 6:35 PM To: sr-users@lists.sip-router.org Subject: Re: [SR-Users] Kamailio LCR module memory concern On 06/10/2015 11:33 AM, Ali Taher wrote: > Can you please

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 11:33 AM, Ali Taher wrote: Can you please tell me what memory should be allocated to handle 44 million rules. How much memory, or how many hash buckets? -- Alex Balashov | Principal | Evariste Systems LLC 303 Perimeter Center North, Suite 300 Atlanta, GA 30346 United States Tel

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
List Subject: [SR-Users] Kamailio LCR module memory concern Ali Taher writes: > I'm using LCR module where I have 44 million rules and 13 million rule > targets (not all rules have destinations). > When I'm setting lcr_rule_hash_size parameter to 268435456 (2 power > 2

[SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Juha Heinanen
Ali Taher writes: > I'm using LCR module where I have 44 million rules and 13 million rule > targets (not all rules have destinations). > When I'm setting lcr_rule_hash_size parameter to 268435456 (2 power 28) I > got the following error : "no memory for rules hash table" in the log it makes no

[SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
Hello, I'm using LCR module where I have 44 million rules and 13 million rule targets (not all rules have destinations). Noting that I'm running Ubuntu on virtual machine with 8GB allocated memory. When I'm setting lcr_rule_hash_size parameter to 268435456 (2 power 28) I got the following err