Re: [squid-users] Help with a tcp_miss/200 issue

2012-03-12 Thread James Ashton
Any thoughts guys?

This has me baffled.  I am digging through list archives, but nothing relevant 
so far. 
I figure it has to be a response header issue.  I just don't see it.

Using Squid 3.1.8
Config is:



http_port 80 accel vhost

# Production Servers
cache_peer xxx.xxx.xxx.xxx parent 80 0 no-query no-digest originserver 
login=PASS name=myAccellb round-robin
#
# user
cache_peer xxx.xxx.xxx.xxx parent 80 0 no-query no-digest originserver 
login=PASS name=puserlb round-robin
#
# Training
cache_peer xxx.xxx.xxx.xxx parent 80 0 no-query no-digest originserver 
login=PASS name=ktrain5 round-robin
#
# Ad Server
cache_peer xxx.xxx.xxx.xxx parent 80 0 no-query no-digest originserver 
login=PASS name=adserver1 round-robin
#
acl PURGE method PURGE
acl manager proto cache_object
acl localhost src 127.0.0.1/255.255.255.255
#acl all src 0.0.0.0/0.0.0.0
#

acl our_sites dstdomain origin.xxx.com
acl our_sites dstdomain streamorigin.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain images.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain media.xxx.com
acl our_sites dstdomain origin-media.xxx.com
acl our_sites dstdomain www.media.xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain portfolio.xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain .com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain members.xxx.com
acl our_sites dstdomain skportfolio.xxx.com
acl our_sites dstdomain xxx.xxx.com
acl our_sites dstdomain mattk.xxx.com
acl our_sites dstdomain planet.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain forum.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain secure.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain xxx.com
acl our_sites dstdomain www.xxx.com
acl our_sites dstdomain secure.xxx.com
acl our_sites dstdomain reviews.xxx.com
acl our_sites dstdomain emails.xxx.com
acl our_sites dstdomain facebook.xxx.com

acl adserver dstdomain cache.ads.xxx.com

acl ktrain dstdomain xxx.com
acl ktrain dstdomain www.xxx.com
acl ktrain dstdomain secure.xxx.com

acl puser dstdomain www.xxx.com
acl puser dstdomain secure.xxx.com
acl puser dstdomain cache.xxx.com
acl puser dstdomain xxx.com

#
http_access allow our_sites
http_access allow manager localhost
http_access deny manager
http_access allow purge localhost
http_access deny purge
#http_access deny all
#
# Main Pool
cache_peer_access myAccellb allow our_sites
cache_peer_access myAccellb deny all
#
#
cache_peer_access ktrain5 allow ktrain
cache_peer_access ktrain5 deny all
#
#
cache_peer_access puserlb allow puser
cache_peer_access puserlb deny all
#
#
cache_peer_access adserver1 allow adserver
cache_peer_access adserver1 deny all
#
#
visible_hostname squid2.kelbymediagroup.com
#
refresh_pattern 
(phpmyadmin|process|register|login|contact|signup|admin|gateway|ajax|account|cart|checkout|members)
 0 10% 0
refresh_pattern (blog|feed) 300 20% 4320
refresh_pattern -i \.(gif|png|jpg|jpeg|ico)$ 40320 75% 86400
refresh_pattern -i \.(iso|avi|wav|mp3|mpeg|swf|flv|x-flv)$ 1440 40% 40320
refresh_pattern -i \.mp4$   1440   90% 43200
refresh_pattern -i \.(css|js)$ 300 40% 7200
refresh_pattern -i \.(html|htm)$ 300 40% 7200
refresh_pattern (/cgi-bin/|\?) 300 20% 4320
refresh_pattern . 300 40% 40320
#
negative_ttl 0 seconds
cache_effective_user squid
cache_mem 4000 MB
cache_replacement_policy heap LFUDA
memory_replacement_policy heap GDSF
maximum_object_size_in_memory 1 MB  # 28 KB
maximum_object_size 1000 MB
cache_dir aufs /caches/cache1 3 64 256
debug_options ALL,1
cache_store_log none
pipeline_prefetch on
#
#
shutdown_lifetime 1 second
httpd_suppress_version_string on
access_log /var/log/squ

Re: [squid-users] Help with a tcp_miss/200 issue

2012-03-12 Thread Amos Jeffries

On 13.03.2012 03:13, James Ashton wrote:

Any thoughts guys?

This has me baffled.  I am digging through list archives, but nothing
relevant so far.
I figure it has to be a response header issue.  I just don't see it.



Could be. You will need to know the headers being sent into Squid 
"squid1.kelbymediagroup.com" from the origin server though. I suspect it 
may be missing Date: header or something like that making the original 
non-cacheable. Squid does many fixing-up of details like that on its 
output to ensure the output is more friendly to downstream clients.




Using Squid 3.1.8


Or it could be some bug in that particular version. Tried the more 
current .19 release?



Config seems okay.


#
visible_hostname squid2.kelbymediagroup.com
#
refresh_pattern

(phpmyadmin|process|register|login|contact|signup|admin|gateway|ajax|account|cart|checkout|members)
0 10% 0
refresh_pattern (blog|feed) 300 20% 4320
refresh_pattern -i \.(gif|png|jpg|jpeg|ico)$ 40320 75% 86400
refresh_pattern -i \.(iso|avi|wav|mp3|mpeg|swf|flv|x-flv)$ 1440 40% 
40320

refresh_pattern -i \.mp4$   1440   90% 43200
refresh_pattern -i \.(css|js)$ 300 40% 7200
refresh_pattern -i \.(html|htm)$ 300 40% 7200
refresh_pattern (/cgi-bin/|\?) 300 20% 4320
refresh_pattern . 300 40% 40320
#




Amos




- Original Message -
From: "James Ashton"

Hello all,
 I am trying to improve caching/acceleration on a series of wordpress 
sites.

Almost all objects are being cached at this point other than the page
HTML itself.
All I am getting there is TCP_MISS/200 log lines.

The request is a GET for the URL  http://planetphotoshop.com

At the moment my response header is:

Cache-Controlmax-age=60
Cneonctionclose
Connectionkeep-alive
Content-Encodinggzip
Content-Length15339
Content-Typetext/html; charset=UTF-8
DateFri, 09 Mar 2012 13:58:01 GMT
ServerApache/2.2.15 (CentOS)
VaryAccept-Encoding
Via1.0 squid1.kelbymediagroup.com (squid)
X-CacheMISS from squid1.kelbymediagroup.com
X-Cache-LookupMISS from squid1.kelbymediagroup.com:80
X-Pingbackhttp://planetphotoshop.com/xmlrpc.php


I dont see anything preventing caching

Any thoughts or ideas?

Thank you in advance for the help.

James




Re: [squid-users] Help with a tcp_miss/200 issue

2012-03-13 Thread James Ashton
Thanks Amos,

The web servers reply to squid with these headers

=
Cache-Control   max-age=60
Connection  Keep-Alive
Content-Encodinggzip
Content-Length  15139
Content-Typetext/html; charset=UTF-8
DateTue, 13 Mar 2012 12:42:26 GMT
Expires Tue, 13 Mar 2012 12:43:26 GMT
Keep-Alive  timeout=15, max=5000
Server  Apache/2.2.15 (CentOS)
VaryAccept-Encoding,User-Agent
X-Pingback  http://planetphotoshop.com/xmlrpc.php
=


They look good to me...
Do you see anything missing from this?

Thank You
James

- Original Message -
From: "Amos Jeffries" 
To: squid-users@squid-cache.org
Sent: Monday, March 12, 2012 10:39:13 PM
Subject: Re: [squid-users] Help with a tcp_miss/200 issue

On 13.03.2012 03:13, James Ashton wrote:
> Any thoughts guys?
>
> This has me baffled.  I am digging through list archives, but nothing
> relevant so far.
> I figure it has to be a response header issue.  I just don't see it.
>

Could be. You will need to know the headers being sent into Squid 
"squid1.kelbymediagroup.com" from the origin server though. I suspect it 
may be missing Date: header or something like that making the original 
non-cacheable. Squid does many fixing-up of details like that on its 
output to ensure the output is more friendly to downstream clients.


> Using Squid 3.1.8

Or it could be some bug in that particular version. Tried the more 
current .19 release?


Config seems okay.

> #
> visible_hostname squid2.kelbymediagroup.com
> #
> refresh_pattern
> 
> (phpmyadmin|process|register|login|contact|signup|admin|gateway|ajax|account|cart|checkout|members)
> 0 10% 0
> refresh_pattern (blog|feed) 300 20% 4320
> refresh_pattern -i \.(gif|png|jpg|jpeg|ico)$ 40320 75% 86400
> refresh_pattern -i \.(iso|avi|wav|mp3|mpeg|swf|flv|x-flv)$ 1440 40% 
> 40320
> refresh_pattern -i \.mp4$   1440   90% 43200
> refresh_pattern -i \.(css|js)$ 300 40% 7200
> refresh_pattern -i \.(html|htm)$ 300 40% 7200
> refresh_pattern (/cgi-bin/|\?) 300 20% 4320
> refresh_pattern . 300 40% 40320
> #



Amos

>
>
> - Original Message -
> From: "James Ashton"
>
> Hello all,
>  I am trying to improve caching/acceleration on a series of wordpress 
> sites.
> Almost all objects are being cached at this point other than the page
> HTML itself.
> All I am getting there is TCP_MISS/200 log lines.
>
> The request is a GET for the URL  http://planetphotoshop.com
>
> At the moment my response header is:
>
> Cache-Controlmax-age=60
> Cneonctionclose
> Connectionkeep-alive
> Content-Encodinggzip
> Content-Length15339
> Content-Typetext/html; charset=UTF-8
> DateFri, 09 Mar 2012 13:58:01 GMT
> ServerApache/2.2.15 (CentOS)
> VaryAccept-Encoding
> Via1.0 squid1.kelbymediagroup.com (squid)
> X-CacheMISS from squid1.kelbymediagroup.com
> X-Cache-LookupMISS from squid1.kelbymediagroup.com:80
> X-Pingbackhttp://planetphotoshop.com/xmlrpc.php
>
>
> I dont see anything preventing caching
>
> Any thoughts or ideas?
>
> Thank you in advance for the help.
>
> James



Re: [squid-users] Help with a tcp_miss/200 issue

2012-03-14 Thread James Ashton
Hello again,
 Does anyone else have any ideas on this?

Thank You
James

- Original Message -
From: "James Ashton" 
To: "Amos Jeffries" 
Cc: squid-users@squid-cache.org
Sent: Tuesday, March 13, 2012 8:44:54 AM
Subject: Re: [squid-users] Help with a tcp_miss/200 issue

Thanks Amos,

The web servers reply to squid with these headers

=
Cache-Control   max-age=60
Connection  Keep-Alive
Content-Encodinggzip
Content-Length  15139
Content-Typetext/html; charset=UTF-8
DateTue, 13 Mar 2012 12:42:26 GMT
Expires Tue, 13 Mar 2012 12:43:26 GMT
Keep-Alive  timeout=15, max=5000
Server  Apache/2.2.15 (CentOS)
VaryAccept-Encoding,User-Agent
X-Pingback  http://planetphotoshop.com/xmlrpc.php
=


They look good to me...
Do you see anything missing from this?

Thank You
James

- Original Message -
From: "Amos Jeffries" 
To: squid-users@squid-cache.org
Sent: Monday, March 12, 2012 10:39:13 PM
Subject: Re: [squid-users] Help with a tcp_miss/200 issue

On 13.03.2012 03:13, James Ashton wrote:
> Any thoughts guys?
>
> This has me baffled.  I am digging through list archives, but nothing
> relevant so far.
> I figure it has to be a response header issue.  I just don't see it.
>

Could be. You will need to know the headers being sent into Squid 
"squid1.kelbymediagroup.com" from the origin server though. I suspect it 
may be missing Date: header or something like that making the original 
non-cacheable. Squid does many fixing-up of details like that on its 
output to ensure the output is more friendly to downstream clients.


> Using Squid 3.1.8

Or it could be some bug in that particular version. Tried the more 
current .19 release?


Config seems okay.

> #
> visible_hostname squid2.kelbymediagroup.com
> #
> refresh_pattern
> 
> (phpmyadmin|process|register|login|contact|signup|admin|gateway|ajax|account|cart|checkout|members)
> 0 10% 0
> refresh_pattern (blog|feed) 300 20% 4320
> refresh_pattern -i \.(gif|png|jpg|jpeg|ico)$ 40320 75% 86400
> refresh_pattern -i \.(iso|avi|wav|mp3|mpeg|swf|flv|x-flv)$ 1440 40% 
> 40320
> refresh_pattern -i \.mp4$   1440   90% 43200
> refresh_pattern -i \.(css|js)$ 300 40% 7200
> refresh_pattern -i \.(html|htm)$ 300 40% 7200
> refresh_pattern (/cgi-bin/|\?) 300 20% 4320
> refresh_pattern . 300 40% 40320
> #



Amos

>
>
> - Original Message -
> From: "James Ashton"
>
> Hello all,
>  I am trying to improve caching/acceleration on a series of wordpress 
> sites.
> Almost all objects are being cached at this point other than the page
> HTML itself.
> All I am getting there is TCP_MISS/200 log lines.
>
> The request is a GET for the URL  http://planetphotoshop.com
>
> At the moment my response header is:
>
> Cache-Controlmax-age=60
> Cneonctionclose
> Connectionkeep-alive
> Content-Encodinggzip
> Content-Length15339
> Content-Typetext/html; charset=UTF-8
> DateFri, 09 Mar 2012 13:58:01 GMT
> ServerApache/2.2.15 (CentOS)
> VaryAccept-Encoding
> Via1.0 squid1.kelbymediagroup.com (squid)
> X-CacheMISS from squid1.kelbymediagroup.com
> X-Cache-LookupMISS from squid1.kelbymediagroup.com:80
> X-Pingbackhttp://planetphotoshop.com/xmlrpc.php
>
>
> I dont see anything preventing caching
>
> Any thoughts or ideas?
>
> Thank you in advance for the help.
>
> James