Re: [squid-users] WARNING: there are more than 100 regular expressions
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 28/11/2014 10:23 p.m., navari.lore...@gmail.com wrote: I saw that the error does not preclude the use of the lines over the 100. I have no problem with the CPU ( 7 % ) . Only I do not like to see Warning The RE engine can scan for individual patterns easily enough but copying patterns into libregex memory and scanning the entire URI 100+ times per transaction is quite an excessive amount of work for the simple task being attempted. Like Marcus said lists of domains are best matched using dstdomain ACL type which does an optimized single scan of just the domain name portion no matter how many entries there are. If you do have no choice but to use RE, then manually combining patterns is best. This warning is just an indication that you need to pay some attention to reducing the count. For example the list containing: facebook\.com fbcdn\.com Can be reduced to: f(acebook|bcdn)\.com If you are importing a public list of domains to block please investigate whether your list source supports squid dstdomain ACL formats. The best lists provide files with Squid dstdomain format (which is also almost identical to the rbldnsd 'RHSBL' data format). Amos -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (MingW32) iQEcBAEBAgAGBQJUfC2DAAoJELJo5wb/XPRjQuoH/31JMC52DYzvZqp1xycEIlwU BTmdZCXZNsnYNklKW0MmN+Li3C3K87d5O07og7EsovG0syFxXlJc5HSvEBgqwQ9v iAqTLkrg23EMKmqU7cM+A6MhMcuCGK7r//JAQiCqG6JD0iDXS5V8GFTOv2FYLr5e yHhJ3p5vbmh/K8Qx6JrThTwNq8h41g9ek1PRG+BQj9iem80ujK8m616dXqhJGB4g 3BvgSHbuhkSD9MfOcz1lkftR1+baBK8XtIn/Ue/MkEmveTzbOre+mXEOryZX9ny+ a9nL6ioOzzAIBVqzaLz00xhZkp7Lm2iifycn8p3p6tPi+zIxcp70TemruOON1uE= =JLTR -END PGP SIGNATURE- ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
Re: [squid-users] WARNING: there are more than 100 regular expressions
Il 01/12/2014 09:57, Amos Jeffries ha scritto: [...] If you are importing a public list of domains to block please investigate whether your list source supports squid dstdomain ACL formats. The best lists provide files with Squid dstdomain format (which is also almost identical to the rbldnsd 'RHSBL' data format). Amos May I suggest: http://www.squidblacklist.org/ I have been using it for almost a year now and it has done a good job for me. Over time I've just had to add a dozen entries and allow some specific URLs to tailor it to my specific company. -- Marcello Romani ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
Re: [squid-users] WARNING: there are more than 100 regular expressions
Maybe you should use a tool that has been created for the only purpose of filtering web sites. Like, e2guardian, squidguard, etc Fred ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
Re: [squid-users] WARNING: there are more than 100 regular expressions
I saw that the error does not preclude the use of the lines over the 100. I have no problem with the CPU ( 7 % ) . Only I do not like to see Warning -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/WARNING-there-are-more-than-100-regular-expressions-tp4668529p4668542.html Sent from the Squid - Users mailing list archive at Nabble.com. ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
Re: [squid-users] WARNING: there are more than 100 regular expressions
tor 2014-11-27 klockan 01:59 -0800 skrev navari.lore...@gmail.com: Consider using less REs ... is not possible. if there is no other solution i will break the files in many files with less then 100 entries. Probably will have the same problem with black list. How many REs do you need in your blacklist? Most blacklists I have seen is domain based, not pattern based. If you don't know what I mean then read up on the difference bewteen dstdom_regex and dstdomain ACL types in Squid. Regards Henrik ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
Re: [squid-users] WARNING: there are more than 100 regular expressions
this is the error: WARNING: there are more than 100 regular expressions. Consider using less REs or use rules without expressions like 'dstdomain'. -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/WARNING-there-are-more-than-100-regular-expressions-tp4668529p4668541.html Sent from the Squid - Users mailing list archive at Nabble.com. ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
Re: [squid-users] WARNING: there are more than 100 regular expressions
Hallo, navari.lore...@gmail.com, Du meintest am 27.11.14: i have these Warnings squid -k parse .. 2014/11/27 09:36:22| Processing: acl direct_urls dstdom_regex /etc/squid/direct_urls.txt 2014/11/27 09:36:22| /etc/squid/squid.conf line 86: acl direct_urls dstdom_regex /etc/squid/direct_urls.txt 2014/11/27 09:36:22| WARNING: there are more than 100 regular expressions.Consider using less REs or use rules without expressions like 'dstdomain'. [...] What can i do ? Consider using less REs ... Viele Gruesse! Helmut ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
Re: [squid-users] WARNING: there are more than 100 regular expressions
Hallo, navari.lore...@gmail.com, Du meintest am 27.11.14: Consider using less REs ... is not possible. Then try something like squidguard with lots of user defined domains and URLs. Viele Gruesse! Helmut ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
Re: [squid-users] WARNING: there are more than 100 regular expressions
On 27/11/14 07:59, navari.lore...@gmail.com wrote: Consider using less REs ... is not possible. so dont worry about this WARNING message. This is just a warning, not an error. If you're aware that using lots of REs can hit hard on the CPU usage, just go for it. -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, NÃO mandem email gertru...@solutti.com.br My SPAMTRAP, do not email it ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
Re: [squid-users] WARNING: there are more than 100 regular expressions
blocking facebook and twitter can be done with ACLs based on dstdomain. they are much faster than REs. Marcus On 11/27/2014 10:01 AM, navari.lore...@gmail.com wrote: ok i don't intend to use REs for blacklisting but only for blocking some sites like facebook twitter... In the other file i have about 120 - 150 REs. -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/WARNING-there-are-more-than-100-regular-expressions-tp4668529p4668535.html Sent from the Squid - Users mailing list archive at Nabble.com. ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users ___ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
