Re: [squid-users] Ignoring query string from url

2008-10-27 Thread nitesh naik
We use query string in each url for bursting cache at client end ( browser) hence its not important for us and it won't provide any incorrect results. We already use similar configuration at CDN level. We are trying to add squid layer between origin and CDN to reduce the load on our origin servers

Re: [squid-users] Delivering ident to url_rewrite_program

2008-10-27 Thread Amos Jeffries
Stefan Adams wrote: On Sun, Oct 26, 2008 at 8:35 PM, Amos Jeffries <[EMAIL PROTECTED]> wrote: Stefan Adams wrote: In squid 3.0STABLE9: Following "Redirector interface is broken re IDENT values" from http://wiki.squid-cache.org/SquidFaq/SquidRedirectors, I can see ident requests appearing in acc

Re: [squid-users] Ignoring query string from url

2008-10-27 Thread Henrik Nordstrom
On mån, 2008-10-27 at 12:30 +0530, nitesh naik wrote: > We use query string in each url for bursting cache at client end ( > browser) hence its not important for us and it won't provide any > incorrect results. We already use similar configuration at CDN level. Why do you do this? > Henrik sugge

Re: [squid-users] Ignoring query string from url

2008-10-27 Thread Matus UHLAR - fantomas
> On mån, 2008-10-27 at 12:30 +0530, nitesh naik wrote: > > We use query string in each url for bursting cache at client end ( > > browser) hence its not important for us and it won't provide any > > incorrect results. We already use similar configuration at CDN level. On 27.10.08 10:09, Henrik No

Re: [squid-users] Ignoring query string from url

2008-10-27 Thread Nitesh Naik
Henrik / Matus , For certain request we don't want client browser to look for object in its cache and everything should be served fresh. CDN will determine expire time for the object. Some of these objects doesn't send out Last modified header. In our case it is not important to pass query string

Re: [squid-users] Ignoring query string from url

2008-10-27 Thread Henrik Nordstrom
On mån, 2008-10-27 at 10:11 +0100, Matus UHLAR - fantomas wrote: > > Write your own url rewriter helper. It's no more than a couple of lines > > perl.. > > shouldn't that be storeurl rewriter? No, since the backend server is not interested in this dummy query string an url rewriter is better. Re

Re: [squid-users] Ignoring query string from url

2008-10-27 Thread nitesh naik
Henrik, Is this code capable for handling requests in parallel ? #!/usr/bin/perl $|=1; while (<>) { s|(.*)\?(.*$)|$1|; print; } Regards Nitesh On Mon, Oct 27, 2008 at 4:04 PM, Henrik Nordstrom <[EMAIL PROTECTED]> wrote: > On mån, 2008-10-27 at 10:11 +0100, Matus UHLAR - fantomas wrote

Re: [squid-users] Ignoring query string from url

2008-10-27 Thread Henrik Nordstrom
On mån, 2008-10-27 at 14:57 +0530, Nitesh Naik wrote: > Is there any sample code available for url rewriter helper which will > process requests in parallel? It doesn't need to process them in parallell unless you really need to scale the rewrites on multiple CPUs or threads making callouts to ot

Re: [squid-users] Ignoring query string from url

2008-10-27 Thread Henrik Nordstrom
On mån, 2008-10-27 at 16:12 +0530, nitesh naik wrote: > Henrik, > > Is this code capable for handling requests in parallel ? It's capable to handle the concurrent helper mode yes. It doesn't process requests in parallell, but you don't need to. Regards Henrik signature.asc Description: This is

Re: [squid-users] Ignoring query string from url

2008-10-27 Thread Henrik Nordstrom
Sorry, forgot the following important line in both BEGIN { $|=1; } should be inserted as the second line in each script (just after the #! line) On mån, 2008-10-27 at 11:48 +0100, Henrik Nordstrom wrote: > Example script removing query strings from any file ending in .ext: > > #!/usr/bin/perl

Re: [squid-users] Ignoring query string from url

2008-10-27 Thread nitesh naik
Henrik, What if I use following code ? logic is same as your program ? #!/usr/bin/perl $|=1; while (<>) { s|(.*)\?(.*$)|$1|; print; next; } Regards Nitesh On Mon, Oct 27, 2008 at 4:25 PM, Henrik Nordstrom <[EMAIL PROTECTED]> wrote: > > Sorry, forgot the following important line in bot

Re: [squid-users] Ignoring query string from url

2008-10-27 Thread Henrik Nordstrom
See earlier response. On mån, 2008-10-27 at 16:59 +0530, nitesh naik wrote: > Henrik, > > What if I use following code ? logic is same as your program ? > > > #!/usr/bin/perl > $|=1; > while (<>) { > s|(.*)\?(.*$)|$1|; > print; > next; > } > > Regards > Nitesh > > On Mon, Oct 27, 200

[squid-users] 2.7 reverse proxy --> compression problems

2008-10-27 Thread Ralf Hildebrandt
I set up a reverse proxy in front to http://www.charite.de (typo3) since it's fucking slow. Now it's fast, but SOME (!) users are reporting the sites: http://www.charite.de/neurologie/ http://www.charite.de/stoffwechsel-centrum/ http://www.charite.de/ch/anaest/ards/ http://www.charite.de/akademie/

Re: [squid-users] 2.7 reverse proxy --> compression problems

2008-10-27 Thread Ralf Hildebrandt
* Ralf Hildebrandt <[EMAIL PROTECTED]>: > I set up a reverse proxy in front to http://www.charite.de (typo3) since it's > fucking slow. Now it's fast, but SOME (!) users are reporting the sites: > > http://www.charite.de/neurologie/ > http://www.charite.de/stoffwechsel-centrum/ > http://www.charit

[squid-users] another config question

2008-10-27 Thread Lou Lohman
Previously, I asked about allowing authorized Users to get access to the Internet without a need to authenticate. I had hoped to use NTLM_AUTH, but it appears hopeless. Try as i might, I cannot get NTLM to work. I CAN, however, get ldap to authenticate against the AD, and when I figure out GROUP

Re: [squid-users] 2.7 reverse proxy --> compression problems

2008-10-27 Thread Simon Waters
On Monday 27 October 2008 15:10:35 Ralf Hildebrandt wrote: > > I think it might be due to mod_deflate on the typo3 box. > I disabled it for now and asked the users for a retest. Was it configured to compress images? I doubt that is especially useful, since most image formats get bigger with reg

Re: [squid-users] 2.7 reverse proxy --> compression problems

2008-10-27 Thread Ralf Hildebrandt
* Simon Waters <[EMAIL PROTECTED]>: > On Monday 27 October 2008 15:10:35 Ralf Hildebrandt wrote: > > > > I think it might be due to mod_deflate on the typo3 box. > > I disabled it for now and asked the users for a retest. > > Was it configured to compress images? It rather looked like an HTML pa

Re: [squid-users] headers say HIT, logs say MISS, payload is truncated...

2008-10-27 Thread Neil Harkins
On Sat, Oct 25, 2008 at 8:54 AM, Henrik Nordstrom <[EMAIL PROTECTED]> wrote: > On fre, 2008-10-24 at 15:44 -0700, Neil Harkins wrote: >> We are using collapsed_forwarding here. I haven't tried disabling it yet. >> >> Unfortunately, since the problem appears to be load-related, I've been >> unable t

Re: [squid-users] headers say HIT, logs say MISS, payload is truncated...

2008-10-27 Thread Henrik Nordstrom
On mån, 2008-10-27 at 12:23 -0700, Neil Harkins wrote: > The timeout is because the Content-Length header is bigger than the > payload it sent. > Every http client/server will hang in that situation. This isn't > simply a misreported > HIT<->MISS in the log, this is absolutely a significant bug wh

Re: [squid-users] 2.7 reverse proxy --> compression problems

2008-10-27 Thread Henrik Nordstrom
On mån, 2008-10-27 at 14:49 +0100, Ralf Hildebrandt wrote: > I set up a reverse proxy in front to http://www.charite.de (typo3) since it's > fucking slow. Now it's fast, but SOME (!) users are reporting the sites: > > http://www.charite.de/neurologie/ > http://www.charite.de/stoffwechsel-centrum/

Re: [squid-users] another config question

2008-10-27 Thread Henrik Nordstrom
On mån, 2008-10-27 at 11:58 -0500, Lou Lohman wrote: > don't have a process that uses the network credentials already in > place to authorize Internet Access. The question is - is it possible > to do that using ldap - or must I continue to beat this NTLM horse to > death? You need NTLM or Negot

Re: [squid-users] headers say HIT, logs say MISS, payload is truncated...

2008-10-27 Thread Neil Harkins
On Mon, Oct 27, 2008 at 2:56 PM, Henrik Nordstrom <[EMAIL PROTECTED]> wrote: > On mån, 2008-10-27 at 12:23 -0700, Neil Harkins wrote: >> The timeout is because the Content-Length header is bigger than the >> payload it sent. >> Every http client/server will hang in that situation. This isn't >> sim

Re: [squid-users] headers say HIT, logs say MISS, payload is truncated...

2008-10-27 Thread Henrik Nordstrom
On mån, 2008-10-27 at 15:56 -0700, Neil Harkins wrote: > I'd like to help and see this get fixed, but as I said earlier, > it happens on about 16% of our test requests, only when > there's 750~1050 reqs/second going through the box, > and pretty much disappears under 500 reqs/s (off-peak). Ouch..