Re: [squid-users] Multi processors
It worked fine. All I have to do now is change the squid service initialization script. Thanks a lot. Mark Nottingham escreveu: Sounds like you want processor affinity; http://www.linuxcommand.org/man_pages/taskset1.html Cheers, On 12/03/2008, at 8:22 AM, Marcos Camões Bourgeaiseau wrote: In parts: 1-One of the most important things to check is that you have different PID's for every instance of squid, see pid_filename Sure. Otherwise you can't even start more than one process. 2-Also, how many cpu's does that box have? Do you see squid always using the same one (I.E. CPU2) Squid always use the same CPU, but others services (apache for exemple) in the same machine use all four CPUs, the Ubuntu itself uses the four CPUs. That I know, this problem only occurs with squid. More info: Each squid instance uses it own cache, have it own squid.conf file and listens in different ports. Thanks one more time, escreveu: Marcos, Ubuntu should work fine with an SMP kernel for squid. Just to double check, with your setup have you followed these guidelines? http://wiki.squid-cache.org/MultipleInstances one of the most important things to check is that you have different PID's for every instance of squid, see pid_filename Also, how many cpu's does that box have? Do you see squid always using the same one (I.E. CPU2) Saul W -Original Message- From: Marcos Camões Bourgeaiseau [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 11, 2008 4:34 PM To: saul waizer; squid-users@squid-cache.org Subject: Re: [squid-users] Multi processors Sorry about that. It is a Ubuntu Feisty with a re-compiled Kernel version 2.6.15.7. We just took out some harware modules. We tried some newer Kernel but we couldn't make it work with the hadware that we have here. And just for clarity: It was OK to put four or more instances running at the same time, but all of those instances keep using the same processor and only that ONE processor. It is such a waste. And we have very limited material to work here. Thanks again, saul waizer escreveu: Marcos, What OS are you running squid on? According to the Docs, squid cannot take advantage of an SMP kernel but there is a reference about having multiple instances of squid running, However some OS's are very specific on how they handle processes, a little more information about your setup would be helpful Saul -Original Message- From: Marcos Camões Bourgeaiseau [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 11, 2008 3:21 PM To: squid-users@squid-cache.org Subject: [squid-users] Multi processors I have compiled squid with those options below: squid -v Squid Cache: Version 2.5.STABLE12 configure options: --sysconfdir=/etc/squid --enable-storeio=aufs,coss,diskd,ufs --enable-poll --enable-delay-pools --enable-linux-netfilter --enable-htcp --enable-carp --with-pthreads --enable-underscores --enable-external --enable-arp-acl --with-maxfd=16384 --enable-async-io=50 --enable-snmp It runs in a machine with 4 Itel Xeon processors, but squid no matter how many instances i start, uses only one processor, and my other three processors stay idle. My Squid.conf is this: (I have cutted-out my acls and http_acces) http_port 8080 hierarchy_stoplist cgi-bin ? acl QUERY urlpath_regex cgi-bin aspx \? no_cache deny QUERY # OPTIONS WHICH AFFECT THE CACHE SIZE cache_mem 3072000 KB maximum_object_size 2 KB minimum_object_size 0 KB maximum_object_size_in_memory 4 MB cache_replacement_policy lru memory_replacement_policy lru # LOGFILE PATHNAMES AND CACHE DIRECTORIES cache_dir ufs /var/spool/squid 5000 16 256 cache_access_log /var/log/squid/access.log cache_log none cache_store_log none pid_filename /var/run/squid.pid # OPTIONS FOR EXTERNAL SUPPORT PROGRAMS ftp_list_width 32 ftp_passive on auth_param basic children 5 auth_param basic realm Squid proxy-caching web server auth_param basic credentialsttl 2 hours auth_param basic casesensitive off # OPTIONS FOR TUNING THE CACHE refresh_pattern ^ftp: 144020% 10080 refresh_pattern ^gopher:14400% 1440 refresh_pattern . 0 20% 4320 quick_abort_pct 98 # MISCELLANEOUS append_domain .rio.rj.gov.br memory_pools_limit 50 MB log_icp_queries off snmp_port 3401 Does anyone have an idea? I have looked up in this list old mails, and have not found anything. Thanks a lot, -- Marcos Camões Bourgeaiseau - KIKO e-mail pessoal: [EMAIL PROTECTED] e-mail institucional: [EMAIL PROTECTED] -- Mark Nottingham [EMAIL PROTECTED] -- Marcos Camões Bourgeaiseau - KIKO e-mail pessoal: [EMAIL PROTECTED] e-mail institucional: [EMAIL PROTECTED]
[squid-users] Multi processors
I have compiled squid with those options below: squid -v Squid Cache: Version 2.5.STABLE12 configure options: --sysconfdir=/etc/squid --enable-storeio=aufs,coss,diskd,ufs --enable-poll --enable-delay-pools --enable-linux-netfilter --enable-htcp --enable-carp --with-pthreads --enable-underscores --enable-external --enable-arp-acl --with-maxfd=16384 --enable-async-io=50 --enable-snmp It runs in a machine with 4 Itel Xeon processors, but squid no matter how many instances i start, uses only one processor, and my other three processors stay idle. My Squid.conf is this: (I have cutted-out my acls and http_acces) http_port 8080 hierarchy_stoplist cgi-bin ? acl QUERY urlpath_regex cgi-bin aspx \? no_cache deny QUERY # OPTIONS WHICH AFFECT THE CACHE SIZE cache_mem 3072000 KB maximum_object_size 2 KB minimum_object_size 0 KB maximum_object_size_in_memory 4 MB cache_replacement_policy lru memory_replacement_policy lru # LOGFILE PATHNAMES AND CACHE DIRECTORIES cache_dir ufs /var/spool/squid 5000 16 256 cache_access_log /var/log/squid/access.log cache_log none cache_store_log none pid_filename /var/run/squid.pid # OPTIONS FOR EXTERNAL SUPPORT PROGRAMS ftp_list_width 32 ftp_passive on auth_param basic children 5 auth_param basic realm Squid proxy-caching web server auth_param basic credentialsttl 2 hours auth_param basic casesensitive off # OPTIONS FOR TUNING THE CACHE refresh_pattern ^ftp: 144020% 10080 refresh_pattern ^gopher:14400% 1440 refresh_pattern . 0 20% 4320 quick_abort_pct 98 # MISCELLANEOUS append_domain .rio.rj.gov.br memory_pools_limit 50 MB log_icp_queries off snmp_port 3401 Does anyone have an idea? I have looked up in this list old mails, and have not found anything. Thanks a lot, -- Marcos Camões Bourgeaiseau - KIKO e-mail pessoal: [EMAIL PROTECTED] e-mail institucional: [EMAIL PROTECTED]
RE: [squid-users] Multi processors
Marcos, What OS are you running squid on? According to the Docs, squid cannot take advantage of an SMP kernel but there is a reference about having multiple instances of squid running, However some OS's are very specific on how they handle processes, a little more information about your setup would be helpful Saul -Original Message- From: Marcos Camões Bourgeaiseau [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 11, 2008 3:21 PM To: squid-users@squid-cache.org Subject: [squid-users] Multi processors I have compiled squid with those options below: squid -v Squid Cache: Version 2.5.STABLE12 configure options: --sysconfdir=/etc/squid --enable-storeio=aufs,coss,diskd,ufs --enable-poll --enable-delay-pools --enable-linux-netfilter --enable-htcp --enable-carp --with-pthreads --enable-underscores --enable-external --enable-arp-acl --with-maxfd=16384 --enable-async-io=50 --enable-snmp It runs in a machine with 4 Itel Xeon processors, but squid no matter how many instances i start, uses only one processor, and my other three processors stay idle. My Squid.conf is this: (I have cutted-out my acls and http_acces) http_port 8080 hierarchy_stoplist cgi-bin ? acl QUERY urlpath_regex cgi-bin aspx \? no_cache deny QUERY # OPTIONS WHICH AFFECT THE CACHE SIZE cache_mem 3072000 KB maximum_object_size 2 KB minimum_object_size 0 KB maximum_object_size_in_memory 4 MB cache_replacement_policy lru memory_replacement_policy lru # LOGFILE PATHNAMES AND CACHE DIRECTORIES cache_dir ufs /var/spool/squid 5000 16 256 cache_access_log /var/log/squid/access.log cache_log none cache_store_log none pid_filename /var/run/squid.pid # OPTIONS FOR EXTERNAL SUPPORT PROGRAMS ftp_list_width 32 ftp_passive on auth_param basic children 5 auth_param basic realm Squid proxy-caching web server auth_param basic credentialsttl 2 hours auth_param basic casesensitive off # OPTIONS FOR TUNING THE CACHE refresh_pattern ^ftp: 144020% 10080 refresh_pattern ^gopher:14400% 1440 refresh_pattern . 0 20% 4320 quick_abort_pct 98 # MISCELLANEOUS append_domain .rio.rj.gov.br memory_pools_limit 50 MB log_icp_queries off snmp_port 3401 Does anyone have an idea? I have looked up in this list old mails, and have not found anything. Thanks a lot, -- Marcos Camões Bourgeaiseau - KIKO e-mail pessoal: [EMAIL PROTECTED] e-mail institucional: [EMAIL PROTECTED] No virus found in this incoming message. Checked by AVG. Version: 7.5.518 / Virus Database: 269.21.7/1325 - Release Date: 3/11/2008 1:41 PM No virus found in this outgoing message. Checked by AVG. Version: 7.5.518 / Virus Database: 269.21.7/1325 - Release Date: 3/11/2008 1:41 PM
Re: [squid-users] Multi processors
Sorry about that. It is a Ubuntu Feisty with a re-compiled Kernel version 2.6.15.7. We just took out some harware modules. We tried some newer Kernel but we couldn't make it work with the hadware that we have here. And just for clarity: It was OK to put four or more instances running at the same time, but all of those instances keep using the same processor and only that ONE processor. It is such a waste. And we have very limited material to work here. Thanks again, saul waizer escreveu: Marcos, What OS are you running squid on? According to the Docs, squid cannot take advantage of an SMP kernel but there is a reference about having multiple instances of squid running, However some OS's are very specific on how they handle processes, a little more information about your setup would be helpful Saul -Original Message- From: Marcos Camões Bourgeaiseau [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 11, 2008 3:21 PM To: squid-users@squid-cache.org Subject: [squid-users] Multi processors I have compiled squid with those options below: squid -v Squid Cache: Version 2.5.STABLE12 configure options: --sysconfdir=/etc/squid --enable-storeio=aufs,coss,diskd,ufs --enable-poll --enable-delay-pools --enable-linux-netfilter --enable-htcp --enable-carp --with-pthreads --enable-underscores --enable-external --enable-arp-acl --with-maxfd=16384 --enable-async-io=50 --enable-snmp It runs in a machine with 4 Itel Xeon processors, but squid no matter how many instances i start, uses only one processor, and my other three processors stay idle. My Squid.conf is this: (I have cutted-out my acls and http_acces) http_port 8080 hierarchy_stoplist cgi-bin ? acl QUERY urlpath_regex cgi-bin aspx \? no_cache deny QUERY # OPTIONS WHICH AFFECT THE CACHE SIZE cache_mem 3072000 KB maximum_object_size 2 KB minimum_object_size 0 KB maximum_object_size_in_memory 4 MB cache_replacement_policy lru memory_replacement_policy lru # LOGFILE PATHNAMES AND CACHE DIRECTORIES cache_dir ufs /var/spool/squid 5000 16 256 cache_access_log /var/log/squid/access.log cache_log none cache_store_log none pid_filename /var/run/squid.pid # OPTIONS FOR EXTERNAL SUPPORT PROGRAMS ftp_list_width 32 ftp_passive on auth_param basic children 5 auth_param basic realm Squid proxy-caching web server auth_param basic credentialsttl 2 hours auth_param basic casesensitive off # OPTIONS FOR TUNING THE CACHE refresh_pattern ^ftp: 144020% 10080 refresh_pattern ^gopher:14400% 1440 refresh_pattern . 0 20% 4320 quick_abort_pct 98 # MISCELLANEOUS append_domain .rio.rj.gov.br memory_pools_limit 50 MB log_icp_queries off snmp_port 3401 Does anyone have an idea? I have looked up in this list old mails, and have not found anything. Thanks a lot, -- Marcos Camões Bourgeaiseau - KIKO e-mail pessoal: [EMAIL PROTECTED] e-mail institucional: [EMAIL PROTECTED]
RE: [squid-users] Multi processors
Marcos, Ubuntu should work fine with an SMP kernel for squid. Just to double check, with your setup have you followed these guidelines? http://wiki.squid-cache.org/MultipleInstances one of the most important things to check is that you have different PID's for every instance of squid, see pid_filename Also, how many cpu's does that box have? Do you see squid always using the same one (I.E. CPU2) Saul W -Original Message- From: Marcos Camões Bourgeaiseau [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 11, 2008 4:34 PM To: saul waizer; squid-users@squid-cache.org Subject: Re: [squid-users] Multi processors Sorry about that. It is a Ubuntu Feisty with a re-compiled Kernel version 2.6.15.7. We just took out some harware modules. We tried some newer Kernel but we couldn't make it work with the hadware that we have here. And just for clarity: It was OK to put four or more instances running at the same time, but all of those instances keep using the same processor and only that ONE processor. It is such a waste. And we have very limited material to work here. Thanks again, saul waizer escreveu: Marcos, What OS are you running squid on? According to the Docs, squid cannot take advantage of an SMP kernel but there is a reference about having multiple instances of squid running, However some OS's are very specific on how they handle processes, a little more information about your setup would be helpful Saul -Original Message- From: Marcos Camões Bourgeaiseau [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 11, 2008 3:21 PM To: squid-users@squid-cache.org Subject: [squid-users] Multi processors I have compiled squid with those options below: squid -v Squid Cache: Version 2.5.STABLE12 configure options: --sysconfdir=/etc/squid --enable-storeio=aufs,coss,diskd,ufs --enable-poll --enable-delay-pools --enable-linux-netfilter --enable-htcp --enable-carp --with-pthreads --enable-underscores --enable-external --enable-arp-acl --with-maxfd=16384 --enable-async-io=50 --enable-snmp It runs in a machine with 4 Itel Xeon processors, but squid no matter how many instances i start, uses only one processor, and my other three processors stay idle. My Squid.conf is this: (I have cutted-out my acls and http_acces) http_port 8080 hierarchy_stoplist cgi-bin ? acl QUERY urlpath_regex cgi-bin aspx \? no_cache deny QUERY # OPTIONS WHICH AFFECT THE CACHE SIZE cache_mem 3072000 KB maximum_object_size 2 KB minimum_object_size 0 KB maximum_object_size_in_memory 4 MB cache_replacement_policy lru memory_replacement_policy lru # LOGFILE PATHNAMES AND CACHE DIRECTORIES cache_dir ufs /var/spool/squid 5000 16 256 cache_access_log /var/log/squid/access.log cache_log none cache_store_log none pid_filename /var/run/squid.pid # OPTIONS FOR EXTERNAL SUPPORT PROGRAMS ftp_list_width 32 ftp_passive on auth_param basic children 5 auth_param basic realm Squid proxy-caching web server auth_param basic credentialsttl 2 hours auth_param basic casesensitive off # OPTIONS FOR TUNING THE CACHE refresh_pattern ^ftp: 144020% 10080 refresh_pattern ^gopher:14400% 1440 refresh_pattern . 0 20% 4320 quick_abort_pct 98 # MISCELLANEOUS append_domain .rio.rj.gov.br memory_pools_limit 50 MB log_icp_queries off snmp_port 3401 Does anyone have an idea? I have looked up in this list old mails, and have not found anything. Thanks a lot, -- Marcos Camões Bourgeaiseau - KIKO e-mail pessoal: [EMAIL PROTECTED] e-mail institucional: [EMAIL PROTECTED] No virus found in this incoming message. Checked by AVG. Version: 7.5.518 / Virus Database: 269.21.7/1325 - Release Date: 3/11/2008 1:41 PM No virus found in this outgoing message. Checked by AVG. Version: 7.5.518 / Virus Database: 269.21.7/1325 - Release Date: 3/11/2008 1:41 PM
Re: [squid-users] Multi processors
In parts: 1-One of the most important things to check is that you have different PID's for every instance of squid, see pid_filename Sure. Otherwise you can't even start more than one process. 2-Also, how many cpu's does that box have? Do you see squid always using the same one (I.E. CPU2) Squid always use the same CPU, but others services (apache for exemple) in the same machine use all four CPUs, the Ubuntu itself uses the four CPUs. That I know, this problem only occurs with squid. More info: Each squid instance uses it own cache, have it own squid.conf file and listens in different ports. Thanks one more time, escreveu: Marcos, Ubuntu should work fine with an SMP kernel for squid. Just to double check, with your setup have you followed these guidelines? http://wiki.squid-cache.org/MultipleInstances one of the most important things to check is that you have different PID's for every instance of squid, see pid_filename Also, how many cpu's does that box have? Do you see squid always using the same one (I.E. CPU2) Saul W -Original Message- From: Marcos Camões Bourgeaiseau [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 11, 2008 4:34 PM To: saul waizer; squid-users@squid-cache.org Subject: Re: [squid-users] Multi processors Sorry about that. It is a Ubuntu Feisty with a re-compiled Kernel version 2.6.15.7. We just took out some harware modules. We tried some newer Kernel but we couldn't make it work with the hadware that we have here. And just for clarity: It was OK to put four or more instances running at the same time, but all of those instances keep using the same processor and only that ONE processor. It is such a waste. And we have very limited material to work here. Thanks again, saul waizer escreveu: Marcos, What OS are you running squid on? According to the Docs, squid cannot take advantage of an SMP kernel but there is a reference about having multiple instances of squid running, However some OS's are very specific on how they handle processes, a little more information about your setup would be helpful Saul -Original Message- From: Marcos Camões Bourgeaiseau [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 11, 2008 3:21 PM To: squid-users@squid-cache.org Subject: [squid-users] Multi processors I have compiled squid with those options below: squid -v Squid Cache: Version 2.5.STABLE12 configure options: --sysconfdir=/etc/squid --enable-storeio=aufs,coss,diskd,ufs --enable-poll --enable-delay-pools --enable-linux-netfilter --enable-htcp --enable-carp --with-pthreads --enable-underscores --enable-external --enable-arp-acl --with-maxfd=16384 --enable-async-io=50 --enable-snmp It runs in a machine with 4 Itel Xeon processors, but squid no matter how many instances i start, uses only one processor, and my other three processors stay idle. My Squid.conf is this: (I have cutted-out my acls and http_acces) http_port 8080 hierarchy_stoplist cgi-bin ? acl QUERY urlpath_regex cgi-bin aspx \? no_cache deny QUERY # OPTIONS WHICH AFFECT THE CACHE SIZE cache_mem 3072000 KB maximum_object_size 2 KB minimum_object_size 0 KB maximum_object_size_in_memory 4 MB cache_replacement_policy lru memory_replacement_policy lru # LOGFILE PATHNAMES AND CACHE DIRECTORIES cache_dir ufs /var/spool/squid 5000 16 256 cache_access_log /var/log/squid/access.log cache_log none cache_store_log none pid_filename /var/run/squid.pid # OPTIONS FOR EXTERNAL SUPPORT PROGRAMS ftp_list_width 32 ftp_passive on auth_param basic children 5 auth_param basic realm Squid proxy-caching web server auth_param basic credentialsttl 2 hours auth_param basic casesensitive off # OPTIONS FOR TUNING THE CACHE refresh_pattern ^ftp: 144020% 10080 refresh_pattern ^gopher:14400% 1440 refresh_pattern . 0 20% 4320 quick_abort_pct 98 # MISCELLANEOUS append_domain .rio.rj.gov.br memory_pools_limit 50 MB log_icp_queries off snmp_port 3401 Does anyone have an idea? I have looked up in this list old mails, and have not found anything. Thanks a lot, -- Marcos Camões Bourgeaiseau - KIKO e-mail pessoal: [EMAIL PROTECTED] e-mail institucional: [EMAIL PROTECTED]
Re: [squid-users] Multi processors
Sounds like you want processor affinity; http://www.linuxcommand.org/man_pages/taskset1.html Cheers, On 12/03/2008, at 8:22 AM, Marcos Camões Bourgeaiseau wrote: In parts: 1-One of the most important things to check is that you have different PID's for every instance of squid, see pid_filename Sure. Otherwise you can't even start more than one process. 2-Also, how many cpu's does that box have? Do you see squid always using the same one (I.E. CPU2) Squid always use the same CPU, but others services (apache for exemple) in the same machine use all four CPUs, the Ubuntu itself uses the four CPUs. That I know, this problem only occurs with squid. More info: Each squid instance uses it own cache, have it own squid.conf file and listens in different ports. Thanks one more time, escreveu: Marcos, Ubuntu should work fine with an SMP kernel for squid. Just to double check, with your setup have you followed these guidelines? http://wiki.squid-cache.org/MultipleInstances one of the most important things to check is that you have different PID's for every instance of squid, see pid_filename Also, how many cpu's does that box have? Do you see squid always using the same one (I.E. CPU2) Saul W -Original Message- From: Marcos Camões Bourgeaiseau [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 11, 2008 4:34 PM To: saul waizer; squid-users@squid-cache.org Subject: Re: [squid-users] Multi processors Sorry about that. It is a Ubuntu Feisty with a re-compiled Kernel version 2.6.15.7. We just took out some harware modules. We tried some newer Kernel but we couldn't make it work with the hadware that we have here. And just for clarity: It was OK to put four or more instances running at the same time, but all of those instances keep using the same processor and only that ONE processor. It is such a waste. And we have very limited material to work here. Thanks again, saul waizer escreveu: Marcos, What OS are you running squid on? According to the Docs, squid cannot take advantage of an SMP kernel but there is a reference about having multiple instances of squid running, However some OS's are very specific on how they handle processes, a little more information about your setup would be helpful Saul -Original Message- From: Marcos Camões Bourgeaiseau [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 11, 2008 3:21 PM To: squid-users@squid-cache.org Subject: [squid-users] Multi processors I have compiled squid with those options below: squid -v Squid Cache: Version 2.5.STABLE12 configure options: --sysconfdir=/etc/squid --enable-storeio=aufs,coss,diskd,ufs --enable-poll --enable-delay- pools --enable-linux-netfilter --enable-htcp --enable-carp --with-pthreads --enable-underscores --enable-external --enable-arp-acl --with-maxfd=16384 --enable-async-io=50 --enable-snmp It runs in a machine with 4 Itel Xeon processors, but squid no matter how many instances i start, uses only one processor, and my other three processors stay idle. My Squid.conf is this: (I have cutted-out my acls and http_acces) http_port 8080 hierarchy_stoplist cgi-bin ? acl QUERY urlpath_regex cgi-bin aspx \? no_cache deny QUERY # OPTIONS WHICH AFFECT THE CACHE SIZE cache_mem 3072000 KB maximum_object_size 2 KB minimum_object_size 0 KB maximum_object_size_in_memory 4 MB cache_replacement_policy lru memory_replacement_policy lru # LOGFILE PATHNAMES AND CACHE DIRECTORIES cache_dir ufs /var/spool/squid 5000 16 256 cache_access_log /var/log/squid/access.log cache_log none cache_store_log none pid_filename /var/run/squid.pid # OPTIONS FOR EXTERNAL SUPPORT PROGRAMS ftp_list_width 32 ftp_passive on auth_param basic children 5 auth_param basic realm Squid proxy-caching web server auth_param basic credentialsttl 2 hours auth_param basic casesensitive off # OPTIONS FOR TUNING THE CACHE refresh_pattern ^ftp: 144020% 10080 refresh_pattern ^gopher:14400% 1440 refresh_pattern . 0 20% 4320 quick_abort_pct 98 # MISCELLANEOUS append_domain .rio.rj.gov.br memory_pools_limit 50 MB log_icp_queries off snmp_port 3401 Does anyone have an idea? I have looked up in this list old mails, and have not found anything. Thanks a lot, -- Marcos Camões Bourgeaiseau - KIKO e-mail pessoal: [EMAIL PROTECTED] e-mail institucional: [EMAIL PROTECTED] -- Mark Nottingham [EMAIL PROTECTED]
