Re: [SR-Users] Kamailio LCR module memory concern

2015-06-11 Thread Abdul Hakeem
? Cheers, Abdul Hakeem -Original Message- From: sr-users [mailto:sr-users-boun...@lists.sip-router.org] On Behalf Of Daniel-Constantin Mierla Sent: Thursday, June 11, 2015 12:11 PM To: Kamailio (SER) - Users Mailing List Subject: Re: [SR-Users] Kamailio LCR module memory concern Hello, you can

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-11 Thread Alex Balashov
Why would you go through the trouble of encapsulating that in some sort of presence layer? Just query Redis directly with redis_cmd() from the ndb_redis module. Whether you need an SQL database or can get by with Redis is a complex topic. It's ultimately a question of how complicated a feature

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-11 Thread Daniel-Constantin Mierla
-router.org Subject: Re: [SR-Users] Kamailio LCR module memory concern On 06/10/2015 04:30 PM, Ali Taher wrote: How did your customer handle 137 million using kamailio lcr? I suppose I should clarify; they did not use Kamailio's lcr module. As I said earlier, I don't think the Kamailio lcr

[SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
Hello, I'm using LCR module where I have 44 million rules and 13 million rule targets (not all rules have destinations). Noting that I'm running Ubuntu on virtual machine with 8GB allocated memory. When I'm setting lcr_rule_hash_size parameter to 268435456 (2 power 28) I got the following

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
List Subject: [SR-Users] Kamailio LCR module memory concern Ali Taher writes: I'm using LCR module where I have 44 million rules and 13 million rule targets (not all rules have destinations). When I'm setting lcr_rule_hash_size parameter to 268435456 (2 power 28) I got the following error

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 11:33 AM, Ali Taher wrote: Can you please tell me what memory should be allocated to handle 44 million rules. How much memory, or how many hash buckets? -- Alex Balashov | Principal | Evariste Systems LLC 303 Perimeter Center North, Suite 300 Atlanta, GA 30346 United States

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
Message- From: sr-users [mailto:sr-users-boun...@lists.sip-router.org] On Behalf Of Alex Balashov Sent: Wednesday, June 10, 2015 6:35 PM To: sr-users@lists.sip-router.org Subject: Re: [SR-Users] Kamailio LCR module memory concern On 06/10/2015 11:33 AM, Ali Taher wrote: Can you please tell me

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Juha Heinanen
Ali Taher writes: This is the number of rules generated from our system for LCR routing (we are dealing with transit traffic). i wonder how it is possible to have so many distinct e.164 prefixes for transit unless you need to deal with individual subscriber numbers. if you deal with

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Juha Heinanen
Ali Taher writes: I just need to know the specs needed for a server in order to be able to handle 44 million or rules using LCR module , and what configuration (parameters) should be applied. I have already answered this. Calculate from lcr_mod.h rule_info struct how much memory one rule

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 11:48 AM, Ali Taher wrote: Hi Alex, I don't know a lot about hash tables , and how hash buckets and memory are related. I just need to know the specs needed for a server in order to be able to handle 44 million or rules using LCR module , and what configuration (parameters)

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 12:52 PM, Juha Heinanen wrote: i wonder how it is possible to have so many distinct e.164 prefixes for transit unless you need to deal with individual subscriber numbers. It's quite possible for folks who run dialler traffic[1], at least in the US. The reasons are: - Most

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
Thanks Alex, So what memory should be allocated to handle 67m buckets ? Is there any documentation for hash tables for kamailio? Ali Sent from my iPhone On Jun 10, 2015, at 6:52 PM, Alex Balashov abalas...@evaristesys.com wrote: On 06/10/2015 11:48 AM, Ali Taher wrote: Hi Alex, I

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 12:00 PM, Ali Taher wrote: So what memory should be allocated to handle 67m buckets ? A better question would be: why do you want to store 44m rules in memory? That's a lot of rules. -- Alex Balashov | Principal | Evariste Systems LLC 303 Perimeter Center North, Suite 300

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
This is the number of rules generated from our system for LCR routing (we are dealing with transit traffic) Ali Sent from my iPhone On Jun 10, 2015, at 7:10 PM, Alex Balashov abalas...@evaristesys.com wrote: On 06/10/2015 12:00 PM, Ali Taher wrote: So what memory should be allocated to

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 12:00 PM, Ali Taher wrote: Is there any documentation for hash tables for kamailio? http://en.wikipedia.org/wiki/Hash_table -- Alex Balashov | Principal | Evariste Systems LLC 303 Perimeter Center North, Suite 300 Atlanta, GA 30346 United States Tel: +1-800-250-5920

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
Thanks Alex you saved my life! will check and try to implement this module Ali Sent from my iPhone On Jun 10, 2015, at 10:55 PM, Alex Balashov abalas...@evaristesys.com wrote: On 06/10/2015 03:53 PM, Ali Taher wrote: Can I configure kamailio to read directly from the database without

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 03:53 PM, Ali Taher wrote: Can I configure kamailio to read directly from the database without setting them in the memory? Sure... http://kamailio.org/docs/modules/4.3.x/modules/sqlops.html -- Alex Balashov | Principal | Evariste Systems LLC 303 Perimeter Center North, Suite

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 04:30 PM, Ali Taher wrote: How did your customer handle 137 million using kamailio lcr? I suppose I should clarify; they did not use Kamailio's lcr module. As I said earlier, I don't think the Kamailio lcr module is appropriate for such a case. -- Alex Balashov | Principal

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
Hi Alex, What do you mean by consider an LCR approach that does not rely on having the entire data set in memory, but instead utilises an efficient, lightweight, but still database-bound query approach. Can I configure kamailio to read directly from the database without setting them in the

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Ali Taher
The case mentioned is exactly our case where we deal with class 4, wholesale carriers with many vendors; just as explained in the provided short duration dialer video where we are using Kamailio lcr as redirect server. Hence, what can we do in order to afford such Huge number of rules? How

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 04:30 PM, Ali Taher wrote: How did your customer handle 137 million using kamailio lcr? Database query to PostgreSQL. -- Alex Balashov | Principal | Evariste Systems LLC 303 Perimeter Center North, Suite 300 Atlanta, GA 30346 United States Tel: +1-800-250-5920 (toll-free) /

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Abdul Hakeem
: Re: [SR-Users] Kamailio LCR module memory concern On 06/10/2015 04:30 PM, Ali Taher wrote: How did your customer handle 137 million using kamailio lcr? I suppose I should clarify; they did not use Kamailio's lcr module. As I said earlier, I don't think the Kamailio lcr module is appropriate

Re: [SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Alex Balashov
On 06/10/2015 05:13 PM, Abdul Hakeem wrote: What do you recommend for such giant 137 million routes or entries ? The same that anyone would recommend for any application that aims to store 137 million rows of anything: a relational database, queried manually from Kamailio route script using

[SR-Users] Kamailio LCR module memory concern

2015-06-10 Thread Juha Heinanen
Ali Taher writes: I'm using LCR module where I have 44 million rules and 13 million rule targets (not all rules have destinations). When I'm setting lcr_rule_hash_size parameter to 268435456 (2 power 28) I got the following error : no memory for rules hash table in the log it makes no