Re: [squid-users] AUFS vs. DISKS

2015-07-20 Thread FredB
Fred and Fred; Could you guys who have been seeing these warnings logged please present a grep of those cache.log lines so I can get a better handle on how many doublings your queues are actually requiring ? I count 5 and 6 warnings respectively in FredB's two earlier log traces.

Re: [squid-users] AUFS vs. DISKS

2015-07-20 Thread FredB
Argh ! now crash 2015/07/20 11:06:36 kid1| WARNING: swapfile header inconsistent with available data 2015/07/20 11:06:36 kid1| Could not parse headers from on disk object 2015/07/20 11:06:36 kid1| BUG 3279: HTTP reply without Date: 2015/07/20 11:06:36 kid1| StoreEntry-key:

Re: [squid-users] AUFS vs. DISKS

2015-07-20 Thread FredB
'accept-encoding=identity,gzip,deflate' 2015/07/20 10:15:00 kid1| clientProcessHit: Vary object loop! 2015/07/20 10:20:49 kid1| clientIfRangeMatch: Weak ETags are not allowed in If-Range: bbfe4fbed01:0 ? 537965ecbcc2d01:0 2015/07/20 10:22:50 kid1| urlParse: Illegal hostname '.xiti.com'

Re: [squid-users] AUFS vs. DISKS

2015-07-20 Thread FredB
2015/07/20 11:06:36 kid1| WARNING: swapfile header inconsistent with available data 2015/07/20 11:06:36 kid1| Could not parse headers from on disk object 2015/07/20 11:06:36 kid1| BUG 3279: HTTP reply without Date: 2015/07/20 11:06:36 kid1| StoreEntry-key: F5761430F887925196458A4696151E9C

Re: [squid-users] How to get the correct size of a denied object ?

2015-07-20 Thread Stakres
Amos, How do you get the real size at the moment with a normal object ? Just do the same I suppose you get the size from the headers, right ? If we know the object is denied, we ask for a head request to know the size and we use it in the log. As the object will be blocked, we don't care this

Re: [squid-users] How to get the correct size of a denied object ?

2015-07-20 Thread Amos Jeffries
On 21/07/2015 5:51 a.m., Stakres wrote: Amos, How do you get the real size at the moment with a normal object ? Just do the same I suppose you get the size from the headers, right ? The log contains the bytes *delivered to the client*. When accounting bandwidth only the actual transfer

Re: [squid-users] Block word in a URL part

2015-07-20 Thread Amos Jeffries
On 21/07/2015 5:24 a.m., Felipe Almeida wrote: Hi all, I have a problem here where I need to block some words within a search result in a URL. For example, a I have those two URLs below: https://www.youtube.com/results?search_query=porn

[squid-users] SSL connction failed due to SNI after content redirection

2015-07-20 Thread Alex Wu
With 3.5.6 code, we found one thing is broken. We used pyredir to rewrite request to a surrogated server enabled SSL connection. Also, we enable this in squid.conf: url_rewrite_host_header on We expect a request to www.foo.com is changed to www.foo-internal.com. squid sends the request

[squid-users] How to get the correct size of a denied object ?

2015-07-20 Thread Stakres
Hi All, As you know, when an object is denied by an ACl or other, the size of the object in the log file is the size of the ERR_* page. Is there a way to get the correct/real size of the blocked object ? I know the url is denied before squid gets the object from internet, but it should be nice

[squid-users] Trying to eliminate field from header reply

2015-07-20 Thread Sebastian Goicochea
Hello, I'm trying to make some modifications to Squid source code. I want to eliminate some fields from the header reply that the server sends. I've been searching through the code but I can't seem to find the exact point to make it work. Does anyone have any clue where (as in which file/s)

Re: [squid-users] How to get the correct size of a denied object ?

2015-07-20 Thread Amos Jeffries
On 21/07/2015 4:40 a.m., Stakres wrote: Antony, I got this idea too, but here we lose (i mean it's not overwritten) the info in the access.log and there is no effect of realtime if you see what I mean... An alternative could to catch the TCP_DENIED with a helper but I did not find the way

Re: [squid-users] How to get the correct size of a denied object ?

2015-07-20 Thread Stakres
Antony, I got this idea too, but here we lose (i mean it's not overwritten) the info in the access.log and there is no effect of realtime if you see what I mean... An alternative could to catch the TCP_DENIED with a helper but I did not find the way yet, i think it cannot be done this way. The

Re: [squid-users] AUFS vs. DISKS

2015-07-20 Thread Amos Jeffries
On 21/07/2015 3:19 a.m., Stakres wrote: Hi Amos, Here is the cache.log to check: http://utimg.unveiltech.com/tmp/amos-cache.tgz Thanks. Looks like my guesstimate was good. You have 9 lines there (4K queue). I'll backport the update shortly as-is. Amos

Re: [squid-users] Trying to eliminate field from header reply

2015-07-20 Thread Amos Jeffries
On 21/07/2015 5:15 a.m., Sebastian Goicochea wrote: Just to add some more information: In squid 3.5.4, I got to the method processMiss inside client_side_reply.cc .. but still couldn't make it work eCAP was created for this purpose. Amos ___

Re: [squid-users] AUFS vs. DISKS

2015-07-20 Thread Stakres
Hi Amos, Here is the cache.log to check: http://utimg.unveiltech.com/tmp/amos-cache.tgz Fred, I compared the 2 source diskd.cc, squid 3.4.8 and 3.5.6 both official, no dif. So, using the diskd 3.4 with the 3.5 does not seem to be a good idea, result should be the same. Fred -- View this

Re: [squid-users] How to get the correct size of a denied object ?

2015-07-20 Thread Antony Stone
On Monday 20 Jul 2015 at 16:27, Stakres wrote: As you know, when an object is denied by an ACl or other, the size of the object in the log file is the size of the ERR_* page. Is there a way to get the correct/real size of the blocked object ? Because here we don't care the size of the ERR

[squid-users] Squid 3.5.5 ssl_bump and ufdbGuard

2015-07-20 Thread Stanford Prescott
This probably more rightly belongs in the ufdbGuard mailing list, but SF has been down for several days and I cannot post there. There is a bit of overlap with ssl_bump and ufdGuard with one of the issues I am having. Maybe someone here who uses ufdbGuard or squidGuard could help me? I am trying

Re: [squid-users] SSL connction failed due to SNI after content redirection

2015-07-20 Thread Alex Rousskov
On 07/20/2015 11:28 AM, Alex Wu wrote: With 3.5.6 code, we found one thing is broken. We used pyredir to rewrite request to a surrogated server enabled SSL connection. Also, we enable this in squid.conf: url_rewrite_host_header on We expect a request to www.foo.com is changed to

Re: [squid-users] SSL connction failed due to SNI after content redirection

2015-07-20 Thread Alex Wu
That's right, It should be as follows: --- a/squid-3.5.6/src/ssl/PeerConnector.cc +++ b/squid-3.5.6/src/ssl/PeerConnector.cc @@ -191,8 +194,10 @@ Ssl::PeerConnector::initializeSsl() // Use SNI TLS extension only when we connect directly // to the origin server and we

Re: [squid-users] SSL connction failed due to SNI after content redirection

2015-07-20 Thread Alex Wu
Overlooked before. This should be right now: --- a/squid-3.5.6/src/ssl/PeerConnector.cc +++ b/squid-3.5.6/src/ssl/PeerConnector.cc @@ -191,8 +194,10 @@ Ssl::PeerConnector::initializeSsl() // Use SNI TLS extension only when we connect directly // to the origin server

Re: [squid-users] Trying to eliminate field from header reply

2015-07-20 Thread Sebastian Goicochea
Just to add some more information: In squid 3.5.4, I got to the method processMiss inside client_side_reply.cc .. but still couldn't make it work Thanks, Sebastian El 20/07/15 a las 14:11, Sebastian Goicochea escribió: Hello, I'm trying to make some modifications to Squid source code. I

Re: [squid-users] Squid 3.5.5 ssl_bump and ufdbGuard

2015-07-20 Thread Marcus Kool
First an introduction in blocking HTTPS: HTTPS is a protocol that is designed to be non-interceptable, and if it is intercepted, the browser will notify the user about this interception. This is very different from HTTP which can easily be intercepted and the interceptor can redirect a browser