Re: [squid-users] Surfing hangs after period of time

2008-05-06 Thread Usrbich

I found the problem, it was regarding the MTU values on my firewall, but at
least, I have my squid tunned up now :-) It works flawlessly. Thanx guys for
your help.


Usrbich wrote:
 
 I am worried about the Request memory hit ratios 0.0% part. This means
 that my memory cache is unaffective, right? Where can I tune this?
 
 Cache information for squid:
   Request Hit Ratios: 5min: 32.8%, 60min: 32.8%
   Byte Hit Ratios:5min: 25.0%, 60min: 25.0%
   Request Memory Hit Ratios:  5min: 0.0%, 60min: 0.0%
   Request Disk Hit Ratios:5min: 50.8%, 60min: 50.8%
   Storage Swap size:  1401944 KB
   Storage Mem size:   1144 KB
   Mean Object Size:   16.21 KB
   Requests given to unlinkd:  0
 
 
 Adrian Chadd wrote:
 
 On Wed, Apr 30, 2008, Usrbich wrote:
 
 In cache.log, all I get is this messages:
 2008/04/30 23:58:25| clientReadRequest: FD 121 (10.19.14.58:2014)
 Invalid
 Request
 2008/04/30 23:58:25| clientReadRequest: FD 112 (10.19.14.58:2013)
 Invalid
 Request
 2008/04/30 23:58:37| clientReadRequest: FD 170 (10.19.13.54:1317)
 Invalid
 Request
 2008/04/30 23:58:38| clientReadRequest: FD 121 (10.19.20.55:1235)
 Invalid
 Request
 2008/04/30 23:58:41| clientReadRequest: FD 169 (10.19.13.54:1318)
 Invalid
 Request
 2008/04/30 23:58:41| clientReadRequest: FD 169 (10.19.13.54:1319)
 Invalid
 Request
 2008/04/30 23:58:50| clientReadRequest: FD 126 (10.19.15.55:1662)
 Invalid
 Request
 
 Is that the cause of my timeout problem?
 
 It'd be ncie to know what that is, but no, that in itself shouldn't hang
 browsing activities.
 
 Is this startup output ok?
 Memory usage for squid via mallinfo():
 total space in arena:   13768 KB
 Ordinary blocks:13023 KB265 blks
 Small blocks:   0 KB  5 blks
 Holding blocks:   244 KB  1 blks
 Free Small blocks:  0 KB
 Free Ordinary blocks: 744 KB
 Total in use:   13267 KB 95%
 Total free:   745 KB 5%
 
 Well, squid is using bugger all memory then.
 
 Debugging this will require a little more effort.. you will probably
 have to begin by fiddling with your server stats and determine what else
 is going on. You may want to run the system call tracer on Squid to see
 what its doing when it slows down to see whats going on.
 
 This sort of stuff is precisely why I suggest people graph as much about
 their
 Squid servers as they can!
 
 
 
 Adrian
 
 -- 
 - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid
 Support -
 - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -
 
 
 
 

-- 
View this message in context: 
http://www.nabble.com/Surfing-hangs-after-period-of-time-tp16976682p17083598.html
Sent from the Squid - Users mailing list archive at Nabble.com.



Re: [squid-users] Surfing hangs after period of time

2008-05-02 Thread Usrbich

I am worried about the Request memory hit ratios 0.0% part. This means that
my memory cache is unaffective, right? Where can I tune this?

Cache information for squid:
Request Hit Ratios: 5min: 32.8%, 60min: 32.8%
Byte Hit Ratios:5min: 25.0%, 60min: 25.0%
Request Memory Hit Ratios:  5min: 0.0%, 60min: 0.0%
Request Disk Hit Ratios:5min: 50.8%, 60min: 50.8%
Storage Swap size:  1401944 KB
Storage Mem size:   1144 KB
Mean Object Size:   16.21 KB
Requests given to unlinkd:  0


Adrian Chadd wrote:
 
 On Wed, Apr 30, 2008, Usrbich wrote:
 
 In cache.log, all I get is this messages:
 2008/04/30 23:58:25| clientReadRequest: FD 121 (10.19.14.58:2014) Invalid
 Request
 2008/04/30 23:58:25| clientReadRequest: FD 112 (10.19.14.58:2013) Invalid
 Request
 2008/04/30 23:58:37| clientReadRequest: FD 170 (10.19.13.54:1317) Invalid
 Request
 2008/04/30 23:58:38| clientReadRequest: FD 121 (10.19.20.55:1235) Invalid
 Request
 2008/04/30 23:58:41| clientReadRequest: FD 169 (10.19.13.54:1318) Invalid
 Request
 2008/04/30 23:58:41| clientReadRequest: FD 169 (10.19.13.54:1319) Invalid
 Request
 2008/04/30 23:58:50| clientReadRequest: FD 126 (10.19.15.55:1662) Invalid
 Request
 
 Is that the cause of my timeout problem?
 
 It'd be ncie to know what that is, but no, that in itself shouldn't hang
 browsing activities.
 
 Is this startup output ok?
 Memory usage for squid via mallinfo():
  total space in arena:   13768 KB
  Ordinary blocks:13023 KB265 blks
  Small blocks:   0 KB  5 blks
  Holding blocks:   244 KB  1 blks
  Free Small blocks:  0 KB
  Free Ordinary blocks: 744 KB
  Total in use:   13267 KB 95%
  Total free:   745 KB 5%
 
 Well, squid is using bugger all memory then.
 
 Debugging this will require a little more effort.. you will probably
 have to begin by fiddling with your server stats and determine what else
 is going on. You may want to run the system call tracer on Squid to see
 what its doing when it slows down to see whats going on.
 
 This sort of stuff is precisely why I suggest people graph as much about
 their
 Squid servers as they can!
 
 
 
 Adrian
 
 -- 
 - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid
 Support -
 - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -
 
 

-- 
View this message in context: 
http://www.nabble.com/Surfing-hangs-after-period-of-time-tp16976682p17019406.html
Sent from the Squid - Users mailing list archive at Nabble.com.



Re: [squid-users] Surfing hangs after period of time

2008-05-01 Thread Amos Jeffries

Usrbich wrote:

I have configured parameters like you told me, but still, same thing happens,
but now, i have only about 30 MB's of RAM left, it isn't swapping yet...
Please help :-(


If you are uncomfortable giving squid lots of RAM, by all means reduce it.

I'm out of ideas. I asked about the VM controls because thought it might 
explain the random pausing. Given that VM is a parallel-shared-OS 
environment.


Amos



Usrbich wrote:

I think there's no control, why do you ask?


Amos Jeffries-2 wrote:

Usrbich wrote:

Hi2all!

My users are experiencing problems with squid few hours after it starts.
I have following configuration: P4 3GHz, 1.1 GB RAM, CentOS, Squid 2.6.
This
is a virtual machine and also a DNS server.
Number of active users at one time is about 40-50. The problem is, when
I
start Squid, it works fine for couple of hours, and then the behaviour
from
the client side is that pages stop to download 10-20 secs, like
everything
stops, then it starts back and so on. When it stops, I hit refresh
button
and then it starts to download again. In that time, my free memory is
around

Hmm, just a random thought.
   Does this VM have any controls which might suspend the squid OS or 
network capabilities for any reason?


Amos
--
Please use Squid 2.6.STABLE19 or 3.0.STABLE4









--
Please use Squid 2.6.STABLE20 or 3.0.STABLE5


Re: [squid-users] Surfing hangs after period of time

2008-04-30 Thread Amos Jeffries

Usrbich wrote:

Hi2all!

My users are experiencing problems with squid few hours after it starts.
I have following configuration: P4 3GHz, 1.1 GB RAM, CentOS, Squid 2.6. This
is a virtual machine and also a DNS server.
Number of active users at one time is about 40-50. The problem is, when I
start Squid, it works fine for couple of hours, and then the behaviour from
the client side is that pages stop to download 10-20 secs, like everything
stops, then it starts back and so on. When it stops, I hit refresh button
and then it starts to download again. In that time, my free memory is around
400MB, that's some 45%, it isn't swapping, cpu is low. I believe my
configuration is wrong, and need some help tunning it. Parameters are
majorly by default values. So, I attach my squid.conf:

http_port 10.19.2.3:8080 


hierarchy_stoplist cgi-bin ?

acl QUERY urlpath_regex cgi-bin \?
cache deny QUERY

acl apache rep_header Server ^Apache
broken_vary_encoding allow apache

cache_mem 32 MB


Pretty low for a machine with 1+ GB RAM.
You could probably bump this up to 128 or 256 without trouble. That 
would let a lot more happen in memory and bypass any storage slow-down.




cache_swap_low 90
cache_swap_high 95

maximum_object_size 4096 KB

memory_replacement_policy lru

cache_dir ufs /var/spool/squid 1500 16 256

access_log /var/log/squid/access.log squid

cache_log /var/log/squid/cache.log

cache_store_log /var/log/squid/store.log

pid_filename /var/run/squid.pid

check_hostnames on

dns_nameservers 10.19.2.3 195.29.149.196

hosts_file /etc/hosts

refresh_pattern ^ftp:   144020% 10080
refresh_pattern ^gopher:14400%  1440
refresh_pattern .   0   20% 4320

acl all src 0.0.0.0/0.0.0.0
acl manager proto cache_object
acl localhost src 127.0.0.1/255.255.255.255
acl to_localhost dst 127.0.0.0/8
acl SSL_ports port 443
acl Safe_ports port 80  # http
acl Safe_ports port 21  # ftp
acl Safe_ports port 443 # https
acl Safe_ports port 70  # gopher
acl Safe_ports port 210 # wais
acl Safe_ports port 1025-65535  # unregistered ports
acl Safe_ports port 280 # http-mgmt
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker
acl Safe_ports port 777 # multiling http
acl CONNECT method CONNECT




http_access allow all


First thing:
  with the above line no other controls you wrote below will ever work.



http_access allow manager localhost
http_access deny manager
http_access deny !Safe_ports
http_access deny CONNECT !SSL_ports

acl zbw_network src 10.19.0.0/16

http_access allow zbw_network
http_access allow localhost
http_access deny all

http_reply_access allow all

icp_access allow all

cache_mgr [EMAIL PROTECTED]

mail_from [EMAIL PROTECTED]

mail_program postfix

visible_hostname nameserver.zbw.intranet

snmp_port 1234

delay_class 1 2

delay_access 1 allow zbw_network
delay_access 1 deny all

delay_parameters 1 -1/-1 128000/164

coredump_dir /var/spool/squid


Amos
--
Please use Squid 2.6.STABLE19 or 3.0.STABLE4


Re: [squid-users] Surfing hangs after period of time

2008-04-30 Thread Usrbich

I think there's no control, why do you ask?


Amos Jeffries-2 wrote:
 
 Usrbich wrote:
 Hi2all!
 
 My users are experiencing problems with squid few hours after it starts.
 I have following configuration: P4 3GHz, 1.1 GB RAM, CentOS, Squid 2.6.
 This
 is a virtual machine and also a DNS server.
 Number of active users at one time is about 40-50. The problem is, when I
 start Squid, it works fine for couple of hours, and then the behaviour
 from
 the client side is that pages stop to download 10-20 secs, like
 everything
 stops, then it starts back and so on. When it stops, I hit refresh button
 and then it starts to download again. In that time, my free memory is
 around
 
 Hmm, just a random thought.
Does this VM have any controls which might suspend the squid OS or 
 network capabilities for any reason?
 
 Amos
 -- 
 Please use Squid 2.6.STABLE19 or 3.0.STABLE4
 
 

-- 
View this message in context: 
http://www.nabble.com/Surfing-hangs-after-period-of-time-tp16976682p16982391.html
Sent from the Squid - Users mailing list archive at Nabble.com.



Re: [squid-users] Surfing hangs after period of time

2008-04-30 Thread Usrbich

I have configured parameters like you told me, but still, same thing happens,
but now, i have only about 30 MB's of RAM left, it isn't swapping yet...
Please help :-(


Usrbich wrote:
 
 I think there's no control, why do you ask?
 
 
 Amos Jeffries-2 wrote:
 
 Usrbich wrote:
 Hi2all!
 
 My users are experiencing problems with squid few hours after it starts.
 I have following configuration: P4 3GHz, 1.1 GB RAM, CentOS, Squid 2.6.
 This
 is a virtual machine and also a DNS server.
 Number of active users at one time is about 40-50. The problem is, when
 I
 start Squid, it works fine for couple of hours, and then the behaviour
 from
 the client side is that pages stop to download 10-20 secs, like
 everything
 stops, then it starts back and so on. When it stops, I hit refresh
 button
 and then it starts to download again. In that time, my free memory is
 around
 
 Hmm, just a random thought.
Does this VM have any controls which might suspend the squid OS or 
 network capabilities for any reason?
 
 Amos
 -- 
 Please use Squid 2.6.STABLE19 or 3.0.STABLE4
 
 
 
 

-- 
View this message in context: 
http://www.nabble.com/Surfing-hangs-after-period-of-time-tp16976682p16988138.html
Sent from the Squid - Users mailing list archive at Nabble.com.



Re: [squid-users] Surfing hangs after period of time

2008-04-30 Thread Usrbich

In cache.log, all I get is this messages:
2008/04/30 23:58:25| clientReadRequest: FD 121 (10.19.14.58:2014) Invalid
Request
2008/04/30 23:58:25| clientReadRequest: FD 112 (10.19.14.58:2013) Invalid
Request
2008/04/30 23:58:37| clientReadRequest: FD 170 (10.19.13.54:1317) Invalid
Request
2008/04/30 23:58:38| clientReadRequest: FD 121 (10.19.20.55:1235) Invalid
Request
2008/04/30 23:58:41| clientReadRequest: FD 169 (10.19.13.54:1318) Invalid
Request
2008/04/30 23:58:41| clientReadRequest: FD 169 (10.19.13.54:1319) Invalid
Request
2008/04/30 23:58:50| clientReadRequest: FD 126 (10.19.15.55:1662) Invalid
Request

Is that the cause of my timeout problem?

Is this startup output ok?
Memory usage for squid via mallinfo():
total space in arena:   13768 KB
Ordinary blocks:13023 KB265 blks
Small blocks:   0 KB  5 blks
Holding blocks:   244 KB  1 blks
Free Small blocks:  0 KB
Free Ordinary blocks: 744 KB
Total in use:   13267 KB 95%
Total free:   745 KB 5%


Usrbich wrote:
 
 I have configured parameters like you told me, but still, same thing
 happens, but now, i have only about 30 MB's of RAM left, it isn't swapping
 yet... Please help :-(
 
 
 Usrbich wrote:
 
 I think there's no control, why do you ask?
 
 
 Amos Jeffries-2 wrote:
 
 Usrbich wrote:
 Hi2all!
 
 My users are experiencing problems with squid few hours after it
 starts.
 I have following configuration: P4 3GHz, 1.1 GB RAM, CentOS, Squid 2.6.
 This
 is a virtual machine and also a DNS server.
 Number of active users at one time is about 40-50. The problem is, when
 I
 start Squid, it works fine for couple of hours, and then the behaviour
 from
 the client side is that pages stop to download 10-20 secs, like
 everything
 stops, then it starts back and so on. When it stops, I hit refresh
 button
 and then it starts to download again. In that time, my free memory is
 around
 
 Hmm, just a random thought.
Does this VM have any controls which might suspend the squid OS or 
 network capabilities for any reason?
 
 Amos
 -- 
 Please use Squid 2.6.STABLE19 or 3.0.STABLE4
 
 
 
 
 
 

-- 
View this message in context: 
http://www.nabble.com/Surfing-hangs-after-period-of-time-tp16976682p16992490.html
Sent from the Squid - Users mailing list archive at Nabble.com.



Re: [squid-users] Surfing hangs after period of time

2008-04-30 Thread Adrian Chadd
On Wed, Apr 30, 2008, Usrbich wrote:
 
 In cache.log, all I get is this messages:
 2008/04/30 23:58:25| clientReadRequest: FD 121 (10.19.14.58:2014) Invalid
 Request
 2008/04/30 23:58:25| clientReadRequest: FD 112 (10.19.14.58:2013) Invalid
 Request
 2008/04/30 23:58:37| clientReadRequest: FD 170 (10.19.13.54:1317) Invalid
 Request
 2008/04/30 23:58:38| clientReadRequest: FD 121 (10.19.20.55:1235) Invalid
 Request
 2008/04/30 23:58:41| clientReadRequest: FD 169 (10.19.13.54:1318) Invalid
 Request
 2008/04/30 23:58:41| clientReadRequest: FD 169 (10.19.13.54:1319) Invalid
 Request
 2008/04/30 23:58:50| clientReadRequest: FD 126 (10.19.15.55:1662) Invalid
 Request
 
 Is that the cause of my timeout problem?

It'd be ncie to know what that is, but no, that in itself shouldn't hang
browsing activities.

 Is this startup output ok?
 Memory usage for squid via mallinfo():
   total space in arena:   13768 KB
   Ordinary blocks:13023 KB265 blks
   Small blocks:   0 KB  5 blks
   Holding blocks:   244 KB  1 blks
   Free Small blocks:  0 KB
   Free Ordinary blocks: 744 KB
   Total in use:   13267 KB 95%
   Total free:   745 KB 5%

Well, squid is using bugger all memory then.

Debugging this will require a little more effort.. you will probably
have to begin by fiddling with your server stats and determine what else
is going on. You may want to run the system call tracer on Squid to see
what its doing when it slows down to see whats going on.

This sort of stuff is precisely why I suggest people graph as much about their
Squid servers as they can!



Adrian

-- 
- Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
- $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -