Re: [squid-users] headers say HIT, logs say MISS, payload is truncated...

2008-10-27 Thread Neil Harkins
On Sat, Oct 25, 2008 at 8:54 AM, Henrik Nordstrom [EMAIL PROTECTED] wrote: On fre, 2008-10-24 at 15:44 -0700, Neil Harkins wrote: We are using collapsed_forwarding here. I haven't tried disabling it yet. Unfortunately, since the problem appears to be load-related, I've been unable

Re: [squid-users] headers say HIT, logs say MISS, payload is truncated...

2008-10-27 Thread Neil Harkins
On Mon, Oct 27, 2008 at 2:56 PM, Henrik Nordstrom [EMAIL PROTECTED] wrote: On mån, 2008-10-27 at 12:23 -0700, Neil Harkins wrote: The timeout is because the Content-Length header is bigger than the payload it sent. Every http client/server will hang in that situation. This isn't simply

[squid-users] headers say HIT, logs say MISS, payload is truncated...

2008-10-24 Thread Neil Harkins
Hi. I'm seeing periodic odd behavior from one of our squid2.6 stable18 (and stable22) boxes during the peak hours when the squid is busiest, but not off-peak, and no other signs of a capacity limit except the occasional queue congestion warning. About 15% of the requests for one url we're

Re: [squid-users] Urgent Help Needed: Any suggestion on CPU utiliztion increased from 73% to 97.5 after cache_mem increased from 4 GB to 8 GB

2008-06-14 Thread Neil Harkins
On Sat, Jun 14, 2008 at 2:25 AM, Henrik Nordstrom [EMAIL PROTECTED] wrote: one Squid instance is running on the cache server , squid .conf : cache_mem 8192 MB maximum_object_size_in_memory 2048 KB This may be the culpit. Squid-2 is very very poor at handling large objects in memory,

Re: [squid-users] RAID is good

2008-03-27 Thread Neil Harkins
Aside from the slight RAID5 performance drawback and the RAID0 failure case drawbacks, I thought the main performance issue with any RAID under squid was with aufs only having a single writer thread, as compared to giving squid multiple writer threads if you mount the disks individually. Of

Re: [squid-users] Re: Re: [squid-users] centralized storage for squid

2008-03-10 Thread Neil Harkins
F5 has some documents on how to implement consisent hashes in bigip irules (tcl), but i wound up writing a custom one for use in front of our squids that only does one checksum per request, as opposed to one per squid in the pool, to avoid wasting cpu cycles on the LB. it uses a precomputed table

[squid-users] any thought to making collapsed_forwarding acl-based?

2008-02-22 Thread Neil Harkins
hi. this might belong on squid-dev, but figure i'll try here first. squid doesn't know if an object is even cacheable until it gets the headers back from origin, thus collapsed forwarding seems to impair performance of non-cacheable content, by blocking what will have to be a separate request

[squid-users] aufs cache_dir growing beyond configured limits?

2007-12-20 Thread Neil Harkins
Aside from the fact that this one is an old version (below), it's a little distressing to see squid occasionally filling up a 1024M partition when configured for: cache_dir aufs /mnt/squid 950 32 384 It's the only thing using the partition, and sometimes squid clears it out itself within a few

Re: [squid-users] aufs cache_dir growing beyond configured limits?

2007-12-20 Thread Neil Harkins
On 12/20/07, Adrian Chadd [EMAIL PROTECTED] wrote: On Thu, Dec 20, 2007, Neil Harkins wrote: Aside from the fact that this one is an old version (below), it's a little distressing to see squid occasionally filling up a 1024M partition when configured for: cache_dir aufs /mnt/squid 950

[squid-users] squid only caching for a few seconds... i.e. MISS/HIT/MISS/HIT

2007-09-19 Thread Neil Harkins
Hi. Our squid appears to be caching .css for only a few seconds, when I expect it should be caching it longer, and doing IMS requests. I've included log excerpts (MISS/HIT/MISS/HIT) and sniffer output below. I've tried both of the following refresh_patterns with no noticeable change:

Re: [squid-users] Re: Akamai-like CDN using squid and a DNS trick

2007-09-05 Thread Neil Harkins
On 9/5/07, Oliver Schoett [EMAIL PROTECTED] wrote: Did you notice any ill effects of Bug 7 (http://www.squid-cache.org/bugs/show_bug.cgi?id=7)? This bug makes Squid deliver resources with expiration times in the past, thus causing the clients to revalidate the resources every time they are

Re: [squid-users] criticism against squid

2007-08-29 Thread Neil Harkins
That was my assessment as well: no object eviction?!? So if your dataset it small enough, then varnish could be as good as... a light webserver and a ramdisk. ;) If you've got a huge amount of content, and want to accelerate the hottest fraction, squid is still the best choice, and can be tuned

[squid-users] few questions around multiple cache_dirs

2007-08-10 Thread Neil Harkins
Hi. I'm in the early stages of designing and testing a config with multiple aufs cache_dirs on squid-2.6.STABLE3 as httpd accel for a lot of content, and have a few questions based on what I've observed thus far: * x-squid-internal/vary stubs appear to be able to wind up on a different cache_dir

[squid-users] few questions around multiple cache_dirs

2007-08-09 Thread Neil Harkins
Hi. I'm in the early stages of designing and testing a config with multiple aufs cache_dirs on squid-2.6.STABLE3 as httpd accel for a lot of content, and have a few questions based on what I've observed thus far: * x-squid-internal/vary stubs appear to be able to wind up on a different cache_dir