Re: [squid-users] Cache size is decreasing
Cache Utilization: Cache Utilisation: Last 5 minutes: sample_start_time = 1270370128.471469 (Sun, 04 Apr 2010 08:35:28 GMT) sample_end_time = 1270370428.475867 (Sun, 04 Apr 2010 08:40:28 GMT) client_http.requests = 74.968901/sec client_http.hits = 32.009531/sec client_http.errors = 0.00/sec client_http.kbytes_in = 63.332405/sec client_http.kbytes_out = 1518.634403/sec client_http.all_median_svc_time = 0.469653 seconds client_http.miss_median_svc_time = 0.898576 seconds client_http.nm_median_svc_time = 0.00 seconds client_http.nh_median_svc_time = 0.444919 seconds client_http.hit_median_svc_time = 0.00 seconds server.all.requests = 47.595969/sec server.all.errors = 0.00/sec server.all.kbytes_in = 1082.214135/sec server.all.kbytes_out = 49.639272/sec server.http.requests = 47.595969/sec server.http.errors = 0.00/sec server.http.kbytes_in = 1082.214135/sec server.http.kbytes_out = 49.639272/sec server.ftp.requests = 0.00/sec server.ftp.errors = 0.00/sec server.ftp.kbytes_in = 0.00/sec server.ftp.kbytes_out = 0.00/sec server.other.requests = 0.00/sec server.other.errors = 0.00/sec server.other.kbytes_in = 0.00/sec server.other.kbytes_out = 0.00/sec icp.pkts_sent = 0.00/sec icp.pkts_recv = 0.00/sec icp.queries_sent = 0.00/sec icp.replies_sent = 0.00/sec icp.queries_recv = 0.00/sec icp.replies_recv = 0.00/sec icp.replies_queued = 0.00/sec icp.query_timeouts = 0.00/sec icp.kbytes_sent = 0.00/sec icp.kbytes_recv = 0.00/sec icp.q_kbytes_sent = 0.00/sec icp.r_kbytes_sent = 0.00/sec icp.q_kbytes_recv = 0.00/sec icp.r_kbytes_recv = 0.00/sec icp.query_median_svc_time = 0.00 seconds icp.reply_median_svc_time = 0.00 seconds dns.median_svc_time = 0.186387 seconds unlink.requests = 0.00/sec page_faults = 0.00/sec select_loops = 1425.702433/sec select_fds = 1506.081254/sec average_select_fd_period = 0.000664/fd median_select_fds = 0.00 swap.outs = 12.696481/sec swap.ins = 34.692825/sec swap.files_cleaned = 8.033216/sec aborted_requests = 1.393313/sec syscalls.polls = 1425.702433/sec syscalls.disk.opens = 33.839504/sec syscalls.disk.closes = 67.665675/sec syscalls.disk.reads = 85.932074/sec syscalls.disk.writes = 147.074511/sec syscalls.disk.seeks = 0.00/sec syscalls.disk.unlinks = 14.563120/sec syscalls.sock.accepts = 56.059178/sec syscalls.sock.sockets = 24.222978/sec syscalls.sock.connects = 24.206312/sec syscalls.sock.binds = 24.222978/sec syscalls.sock.closes = 53.089222/sec syscalls.sock.reads = 679.016712/sec syscalls.sock.writes = 790.638409/sec syscalls.sock.recvfroms = 6.759901/sec syscalls.sock.sendtos = 3.409950/sec cpu_time = 22.005375 seconds wall_time = 300.004398 seconds cpu_usage = 7.335017% Squid Object Cache: Version 2.7.STABLE9 Connection information for squid: Number of clients accessing cache: 0 Number of HTTP requests received: 19761492 Number of ICP messages received:0 Number of ICP messages sent:0 Number of queued ICP replies: 0 Request failure ratio: 0.00 Average HTTP requests per minute since start: 7439.0 Average ICP messages per minute since start:0.0 Select loop called: 235829976 times, 0.676 ms avg Cache information for squid: Request Hit Ratios: 5min: 41.4%, 60min: 43.1% Byte Hit Ratios:5min: 27.6%, 60min: 24.7% Request Memory Hit Ratios: 5min: 33.6%, 60min: 29.2% Request Disk Hit Ratios:5min: 37.9%, 60min: 39.3% Storage Swap size: 301573020 KB Storage Mem size: 5243024 KB Mean Object Size: 23.09 KB Requests given to unlinkd: 0 Median Service Times (seconds) 5 min60 min: HTTP Requests (All): 0.46965 0.44492 Cache Misses: 0.89858 0.85130 Cache Hits:0.0 0.0 Near Hits: 0.44492 0.46965 Not-Modified Replies: 0.0 0.0 DNS Lookups: 0.18639 0.18639 ICP Queries: 0.0 0.0 Resource usage for squid: UP Time:159388.998 seconds CPU Time: 14041.662 seconds CPU Usage: 8.81% CPU Usage, 5 minute avg:7.24% CPU Usage, 60 minute avg: 5.94% Process Data Segment Size via sbrk(): 1040036 KB Maximum Resident Size: 0 KB Page faults with physical i/o: 3 Memory usage for squid via mallinfo(): Total space in arena: 233180 KB Ordinary blocks: 225885 KB 11433 blks Small blocks: 0 KB 0 blks Holding blocks:276604 KB 5 blks Free Small blocks: 0 KB Free Ordinary blocks:7294 KB Total in use: 502489 KB 99% Total free: 7294 KB 1% Total size:509784 KB Memory accounted for: Total accou
Re: [squid-users] Error building 2.7.STABLE9 on OSX 10.5.8
On Apr 3, 2010, at 1:40 PM, Henrik Nordstrom wrote: mån 2010-03-29 klockan 05:46 -0700 skrev Ricardo Newbery: I get the following error when trying to build 2.7.STABLE9 on OSX 10.5.8. Any suggestions? your error seem similar to an error we have been seeing with 3.0 in the built test farm, where it seems that some OS:es have trouble with that very long sed line, escpecially when the install prefix is a little longer than usual. Maybe the attached patch will help. In either case please file a bug report http://bugs.squid-cache.org/ Regards Henrik Thanks Henrik, I should have updated this post. After fiddling with this install for a bit, it mysteriously fixed itself. Now I can't reproduce the original error, even with a virgin download. Shrug. Ric
[squid-users] Accessing my websites is extremely slow
Hi all, Accessing my websites is extremely slow, it can take up to 5 minutes for the page to load some pages in the admin area won't even load no matter how long I wait. Squid is getting extremely slow Any ideas or suggestion on how to solve this problem please I know everyone is saying "it's not squid" I am sorry bu it is squid, I never experienced all of these problems before in the 15 years I ran these websites I never had anything like until the moment I installed and ran squid I am having all sorts of problems. Any suggestions would be very much appreciated Thank you all Regards Adam
Re: [squid-users] Accessing my websites is extremely slow
a...@gmail wrote: Hi all, Accessing my websites is extremely slow, it can take up to 5 minutes for the page to load some pages in the admin area won't even load no matter how long I wait. Squid is getting extremely slow Any ideas or suggestion on how to solve this problem please I know everyone is saying "it's not squid" I am sorry bu it is squid, I never experienced all of these problems before in the 15 years I ran these websites I never had anything like until the moment I installed and ran squid I am having all sorts of problems. Any suggestions would be very much appreciated Thank you all Regards Adam When you restart Squid does that speed it up? What is the ratio of hits getting through to Apache compared to those being served by Squid. How much cache space have you allocated? How are the levels structured? Ron
Re: [squid-users] Yet another IMAP support request
fre 2010-03-19 klockan 14:33 +0100 skrev Matus UHLAR - fantomas: > On 19.03.10 15:00, Sabyasachi Ruj wrote: > > I went through this thread: > > http://www.mail-archive.com/squid-users@squid-cache.org/msg59892.html. > > I also needed that IMAP to work via Squid. There was no conclusion on > > that thread. > > need? Why do you _need_ it? Very valid question. Most people prefer handing IMAP and other random protocols by using NAT instead of via an HTTP proxy. The second alternative on the preferred list is using a generic SOCKS proxy, possibly with an automatic wrapper installed on the client stations to divert network requests to the SOCKS server.. There is also the alternative of using an IMAP proxy, which sometimes even adds benefits such as cache etc.. (mostly interesting for dumb clients not having a good local cache themselves) Regards Henrik
Re: [squid-users] Error building 2.7.STABLE9 on OSX 10.5.8
sön 2010-04-04 klockan 02:05 -0700 skrev Ricardo Newbery: > I should have updated this post. After fiddling with this install for > a bit, it mysteriously fixed itself. Now I can't reproduce the > original error, even with a virgin download. Shrug. Are you using the same configure options and have the sources in the same location as before? Regards Henrik
RE: [squid-users] Reverse Proxy SSL Options
fre 2010-03-19 klockan 10:09 -0500 skrev Dean Weimer: > Thanks for the info that worked, almost, I added the following entries. > > sslproxy_options NO_SSLv2 > sslproxy_cipher > ALL:!aNULL:!eNULL:!LOW:!EXP:!ADH:!RC4+RSA:+HIGH:+MEDIUM:!SSLv2 sslproxy_* options is the wrong place. You as you discovered you need to set these SSL parameters in the https_port line. sslproxy_* parameters control what Squid requires on outgoing SSL connections it makes when forwarding an https:// URL and not using a peer... I very much doubt you need to care about these. There is two main situations when Squid forwards https:// URLs a) When requested by a client without native SSL support. I.e. old versions of lynx. b) When using a redirector to rewrite http:// URLs into https:// without usign a browser redirect. C) an ssl reverse proxy configured with direct forwarding without using cache_peer. Regards Henrik
[squid-users] Slow access to web site using squid and Internet explorer.
Hello all, I am trying to troubleshoot an issue I am stuck on. We have a website that is loading .htm documents extremely slow when using Internet Explorer 8 behind Squid. When we bypass the proxy and go directly out to the internet all is fast and pages load fine. But when the proxy is on documents will take sometimes up to 6 minutes to load. This issue is only apparent using Internet explorer 8. I do not see the issue when using firefox with Squid. I have tried to use the no_cache directive thinking it may have been the cache but that didn't work either. I am attaching our access.log, store.log and squid.conf. Can anyone see what is going on here? I have been stumped for a week solid. store.log Wed Mar 31 06:10:35 2010 RELEASE -1 A36B60438D93991E458DE08228DEB8AB 0 -1 -1 -1 unknown -1/0 GET http://example.exmp.com/NSValidation.js Wed Mar 31 06:10:35 2010 RELEASE -1 17A9A4E4A51DEF4D34825040A9A79C78 0 -1 -1 -1 unknown -1/0 GET http://example.exmp.com/NSWebForms.js Wed Mar 31 06:10:35 2010 RELEASE -1 E22614CB42B208827CD18D8027B51E24 200 1270410086 -1 -1 text/html 24383/24383 GET http://example.exmp.com/PICDetail.aspx? Wed Mar 31 06:10:35 2010 RELEASE -1 ADDF15CC03D667D6A39014CEF9B4D7AC 404 1270409537 -1 -1 text/html 1635/1635 GET http://example.exmp.com/NSWebForms.js Wed Mar 31 06:10:35 2010 RELEASE -1 651D0D8763381B9F3F4EDF81A7DD2D35 404 1270409537 -1 -1 text/html 1635/1635 GET http://example.exmp.com/NSValidation.js Wed Mar 31 06:10:35 2010 RELEASE -1 B7CEF234ADE17CDDA59C871206B5953F 0 -1 -1 -1 unknown -1/0 GET http://example.exmp.com/wdocs/librarian.js Wed Mar 31 06:10:35 2010 RELEASE -1 806BDF950CFB9C5F45028A475E8570F7 404 1270409537 -1 -1 text/html 1635/1635 GET http://example.exmp.com/wdocs/librarian.js Wed Mar 31 06:10:37 2010 RELEASE 00 0188 F3408625B208BEB08F30778CFA480D6E 200 1270409539 1249504825 -1 text/html 170909/0 HEAD http://example.exmp.com/wdocs/8900.1/v03%20tech%20admin/chapter%2054/03_054_006.htm Wed Mar 31 06:10:37 2010 SWAPOUT 00 018E F3408625B208BEB08F30778CFA480D6E 200 1270410087 1249504825 -1 text/html 170909/0 HEAD http://example.exmp.com/wdocs/8900.1/v03%20tech%20admin/chapter%2054/03_054_006.htm Wed Mar 31 06:11:38 2010 RELEASE 00 0189 57CA163F116044F7A702084D937C73DF 200 1270409599 1239994150 -1 text/html 170461/0 HEAD http://example.exmp.com/wdocs/8900.1/v03%20tech%20admin/chapter%2019/03_019_005.htm Wed Mar 31 06:11:38 2010 SWAPOUT 00 018F 57CA163F116044F7A702084D937C73DF 200 1270410149 1239994150 -1 text/html 170461/0 HEAD http://example.exmp.com/wdocs/8900.1/v03%20tech%20admin/chapter%2019/03_019_005.htm Wed Mar 31 06:12:38 2010 RELEASE 00 018A 7121856257D2BD25F321B8B7A804A286 200 1270409660 1268334834 -1 text/html 97961/0 HEAD http://example.exmp.com/wdocs/8900.1/v03%20tech%20admin/chapter%2020/03_020_001.htm Wed Mar 31 06:12:38 2010 SWAPOUT 00 0190 7121856257D2BD25F321B8B7A804A286 200 1270410209 1268334834 -1 text/html 97961/0 HEAD http://example.exmp.com/wdocs/8900.1/v03%20tech%20admin/chapter%2020/03_020_001.htm Wed Mar 31 06:13:39 2010 RELEASE 00 018B E420417DAA8FCE586A0B029E9716EE83 200 1270409722 1239986974 -1 text/html 94338/0 HEAD http://example.exmp.com/wdocs/8900.1/v03%20tech%20admin/chapter%2019/03_019_001.htm Wed Mar 31 06:13:39 2010 SWAPOUT 00 0191 E420417DAA8FCE586A0B029E9716EE83 200 1270410269 1239986974 -1 text/html 94338/0 HEAD http://example.exmp.com/wdocs/8900.1/v03%20tech%20admin/chapter%2019/03_019_001.htm Wed Mar 31 06:14:40 2010 RELEASE 00 018C D930491EC8FAC335130396678E1E62BA 200 1270409782 1253121400 -1 text/html 36090/0 HEAD http://example.exmp.com/wdocs/8900.1/v03%20tech%20admin/chapter%2001/03_001_001.htm Wed Mar 31 06:14:40 2010 SWAPOUT 00 0192 D930491EC8FAC335130396678E1E62BA 200 1270410330 1253121400 -1 text/html 36090/0 HEAD http://example.exmp.com/wdocs/8900.1/v03%20tech%20admin/chapter%2001/03_001_001.htm Wed Mar 31 06:15:41 2010 RELEASE 00 018D B4F1E724EB3ABA6BDD446420E71E94CA 200 1270409842 1267112790 -1 text/html 34397/0 HEAD http://example.exmp.com/wdocs/8900.1/v03%20tech%20admin/chapter%2028/03_028_001.htm Wed Mar 31 06:15:41 2010 SWAPOUT 00 0193 B4F1E724EB3ABA6BDD446420E71E94CA 200 1270410392 1267112790 -1 text/html 34397/0 HEAD http://example.exmp.com/wdocs/8900.1/v03%20tech%20admin/chapter%2028/03_028_001.htm access.log ed Mar 31 06:10:35 2010 64 192.168.2.241 TCP_MISS/000 0 GET http://example.exmp.com/NSValidation.js - DIRECT/162.58.34.7 - [Accept: */*\r\nReferer: http://example.exmp.com/PICDetail.aspx?docId=BC48242830F9A8FA862573D0006CB2EF\r\nAccept-Language: en-us\r\nUser-Agent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0)\r\nAccept-Encoding: gzip, deflate\r\nHo
Re: [squid-users] Yet another IMAP support request
I went through this thread: http://www.mail-archive.com/squid-users@squid-cache.org/msg59892.html. I also needed that IMAP to work via Squid. There was no conclusion on that thread. Sure there was a conclusion. A dozen people said "squid is a HTTP proxy, not an IMAP proxy". There are IMAP proxies out there, but you will not find them via this list. IMAP is a protocol that differs a lot from HTTP and there is no easy way to write software that proxies two very different protocols. JC
Re: [squid-users] Accessing my websites is extremely slow
Hi Ron, Thanks for your reply At the moment I kept everything as default I haven't allocated any extra cache space as yet when I restart it it doesn't really speed it up that much yes there's a slight difference for a short while I get the access.log filled so quickly to the point where I have to empty it into tries the cache.log and store.log are ok, but the access.log gets filled so quickly I have disabled it for now, to see whether it will make a difference. I have to wait til tomorrow I am trying to see if there's any noticeable change in the loading of the pages One other thing is one of my websites requires the license activation to run to it's potential but I am getting these errors since Squid. Warning: fopen() [function.fopen]: php_network_getaddresses: getaddrinfo failed: Name or service not known in /var/www/folder/functions.php on line 2341 Warning: fopen(http://www.someothersite.com/licence_server.php?licence_check=1&li=bs7F9VfU&url=www.mysite.net) [function.fopen]: failed to open stream: No such file or directory in /var/www/folder/functions.php on line 2341 Warning: feof(): supplied argument is not a valid stream resource in /var/www/folder/functions.php on line 2343 Warning: fread(): supplied argument is not a valid stream resource in /var/www/folder/functions.php on line 2345 I get these errors in the admin area instead of getting the validation of my license, I get these errors "Warnings" As for the ratio of hits, there a lot of them that fail similar to the errors mentioned above of various files and folders of various apps in my three sites. I hope that helps a bit Regards Adams - Original Message - From: "Ron Wheeler" Cc: Sent: Sunday, April 04, 2010 7:23 PM Subject: Re: [squid-users] Accessing my websites is extremely slow a...@gmail wrote: Hi all, Accessing my websites is extremely slow, it can take up to 5 minutes for the page to load some pages in the admin area won't even load no matter how long I wait. Squid is getting extremely slow Any ideas or suggestion on how to solve this problem please I know everyone is saying "it's not squid" I am sorry bu it is squid, I never experienced all of these problems before in the 15 years I ran these websites I never had anything like until the moment I installed and ran squid I am having all sorts of problems. Any suggestions would be very much appreciated Thank you all Regards Adam When you restart Squid does that speed it up? What is the ratio of hits getting through to Apache compared to those being served by Squid. How much cache space have you allocated? How are the levels structured? Ron
Re: [squid-users] Not accessing privoxy parent
ons 2010-03-24 klockan 10:51 + skrev Gerard Earley: > Hi all > I'm trying to set up squid as a adblocking proxy by using privoxy > as a parent. > Unfortunately squid doesn't seem to want to access the parent privoxy. > The authentication works, its simply accessing the parent that's not > doing what it should. > > Any help would be appreciated. > > via off > forwarded_for off > http_port 3128 > access_log /var/log/squid/access.log squid > cache_peer 127.0.0.1 parent 8118 7 no-query no-digest > #acl office_network src xx.xx.xx.xx > #http_access allow office_network > visible_hostname xx.com > auth_param basic program /usr/lib/squid/ncsa_auth > /etc/squid/squid_passwords.txt > acl ncsa_users proxy_auth REQUIRED > http_access allow ncsa_users Try adding never_direct allow all Regards Henrik
Re: [squid-users] Performance behind proxy
tor 2010-04-01 klockan 16:26 -0500 skrev Kevin Blackwell: > I know, > > But the problem with that is I have 30 users on a term server. Trying > to track who's going where. Which means you are pretty much stuck at using authentication. Regards Henrik
Re: [squid-users] Slow access to web site using squid and Internet explorer.
The high amount of TCP_MISS/000 in that request list is worrying. Those are requests where Squid never saw a response from the requested server before the client gave up. Other than that there was no obvious culpits in your log snippet. Which makes me wonder if there is a persistent connections issue. Try if there is any difference if you set "client_persistent_connections off" in squid.conf. Regards Henrik
[squid-users] Offline mode for "mobile" internet kiosk?
All, Forgive me if I'm misremembering, but I have a vague recollection of some discussion on this list of some individuals or organization using squid's offline mode as a way to bring a (admittedly limited) subset of internet content to a remote internet-inaccessible areas - a bookmobile for the information age of sorts. Anyone have any details on who/where this was being done? Thanks, -Chris
Re: [squid-users] Yet another IMAP support request
Well, I have implemented the client which can connect to IMAP via squid. You just need to use "CONNECT" method of HTTP protocol. If you see FileZilla, it can also connect to SFTP via squid. On Mon, Apr 5, 2010 at 1:57 AM, Jakob Curdes wrote: > I went through this thread: http://www.mail-archive.com/squid-users@squid-cache.org/msg59892.html. I also needed that IMAP to work via Squid. There was no conclusion on that thread. > > Sure there was a conclusion. A dozen people said "squid is a HTTP proxy, not > an IMAP proxy". > There are IMAP proxies out there, but you will not find them via this list. > IMAP is a protocol that differs a lot from HTTP > and there is no easy way to write software that proxies two very different > protocols. > > > JC -- Sabyasachi
