Re: [squid-users] Stability problems with diskd in Squid 2.6

2006-09-02 Thread Adrian Chadd
On Sun, Sep 03, 2006, Ralf Hildebrandt wrote:

> > Anyhow, I've done preparations to produce backtraces, and will get back
> > on this once I have more to report.
> 
> You'll probably get the ones I'm getting.

Have you lodged bugzilla reports?

I can't reproduce diskd issues - I don't have a beefy-enough FreeBSD
server to do it with - so its difficult to fix.

Just start keeping crashdumps and we'll see how far we get in repairing
the code.




Adrian



Re: [squid-users] Stability problems with diskd in Squid 2.6

2006-09-02 Thread Ralf Hildebrandt
* Anders Nordby <[EMAIL PROTECTED]>:

> Squid doesn't die (and stay dead) non me, it just restarts itself. But
> when it happens, I lose the cache in RAM, which is the main problem.
> Also, the bug occurs more often when under high load, making cache hit
> ratio fluctuate a lot.

Same here. It usually is being restarted at noon, when the load is
highest.

> Anyhow, I've done preparations to produce backtraces, and will get back
> on this once I have more to report.

You'll probably get the ones I'm getting.

-- 
Ralf Hildebrandt (i.A. des IT-Zentrums) [EMAIL PROTECTED]
Charite - Universitätsmedizin BerlinTel.  +49 (0)30-450 570-155
Gemeinsame Einrichtung von FU- und HU-BerlinFax.  +49 (0)30-450 570-962
IT-Zentrum Standort CBF send no mail to [EMAIL PROTECTED]


Re: [squid-users] Stability problems with diskd in Squid 2.6

2006-09-02 Thread Henrik Nordstrom
lör 2006-09-02 klockan 12:22 +0200 skrev Anders Nordby:

> I am using Squid 2.6.STABLE3 in FreeBSD 6.1, on multiple servers running
> web acceleration. After upgrading to 2.6, Squid frequently dies on me in
> two different ways:
> 
> 2006/09/01 22:39:10| assertion failed: cbdata.c:359: "c->y ==
> CBDATA_COOKIE(p)"
> 
> 2006/09/01 22:41:14| assertion failed: diskd/store_io_diskd.c:387:
> "!diskdstate-
> >flags.close_request"

These looks quite familiar. There is a long standing bug in diskd which
noone has gotten around to fix, and I think you may have got bitten by
it..

http://www.squid-cache.org/bugs/show_bug.cgi?id=761


It's possibe something in 2.6 makes the issue likelier to occur, but it
is by no means a new bug.. Has been with us since 2.4..

Regards
Henrik


signature.asc
Description: Detta är en digitalt signerad	meddelandedel


Re: [squid-users] Stability problems with diskd in Squid 2.6

2006-09-02 Thread Anders Nordby
Hi,

On Sat, Sep 02, 2006 at 09:58:58PM +0200, Ralf Hildebrandt wrote:
>>>I am using diskd, with 5 cache dirs on each server (each dir containing
>>>quite a lot of directories). If I turn off diskd and use plain ufs cache
>>>dirs, the instabilitity problem goes away, but then the servers become
>>>very slow to respond. :-( Which I/we can not live with. As 2.6 is
>>>supposed to be faster than 2.5 because of kqueue, downgrading doesn't
>>>seem like a good option either.
> I "fixed" that by running squid under "runit"

Squid doesn't die (and stay dead) non me, it just restarts itself. But
when it happens, I lose the cache in RAM, which is the main problem.
Also, the bug occurs more often when under high load, making cache hit
ratio fluctuate a lot.

So, runit wouldn't help me. I need to protect my backend servers from
load as much as possible. Squid needs to run constantly and stable for
day after day, keeping a constant high cache hit ratio (which it does
fine as long as it is stable).

Anyhow, I've done preparations to produce backtraces, and will get back
on this once I have more to report.

Cheers,

-- 
Anders.


Re: [squid-users] Stability problems with diskd in Squid 2.6

2006-09-02 Thread Ralf Hildebrandt
* Michał Margula <[EMAIL PROTECTED]>:
> Anders Nordby wrote:
> >I am using diskd, with 5 cache dirs on each server (each dir containing
> >quite a lot of directories). If I turn off diskd and use plain ufs cache
> >dirs, the instabilitity problem goes away, but then the servers become
> >very slow to respond. :-( Which I/we can not live with. As 2.6 is
> >supposed to be faster than 2.5 because of kqueue, downgrading doesn't
> >seem like a good option either.

I "fixed" that by running squid under "runit"

-- 
Ralf Hildebrandt (i.A. des IT-Zentrums) [EMAIL PROTECTED]
Charite - Universitätsmedizin BerlinTel.  +49 (0)30-450 570-155
Gemeinsame Einrichtung von FU- und HU-BerlinFax.  +49 (0)30-450 570-962
IT-Zentrum Standort CBF send no mail to [EMAIL PROTECTED]


[squid-users] FreeBSD 7,myport acl, transparent proxying

2006-09-02 Thread Bokhan Artem

myport acl doesn't work on FreeBSD 7 with squid 2.5 or 2.6 and
tranparent proxying with ipfw
I didn't test it on other versions of FreeBSD, but on Linux this
construnction worked fine:

acl ACL1 myport 
acl ACL2 myport 

tcp_outgoing_address 1.1.1.1 ACL1
tcp_outgoing_address 2.2.2.2 ACL2

Any ideas? Is it normal behavior or bug?




Re: [squid-users] Squid 2/3 slower than direct access

2006-09-02 Thread Michael Loftis



--On September 2, 2006 7:53:59 PM +1000 Greg Wilson 
<[EMAIL PROTECTED]> wrote:



I've installed Squid on a HP DL380 server with dual cpus, 2 Gb RAM and
SCSI raid 5. It's running on Debian Sarge with little extra load. I am


Well...it shouldn't have much to do with the speed of Squid if it's a 
hardware RAIDbut has the RAID 5 set finished building?  Also are there 
no failed disks in the set?



using this for our staff of around 100 and though this would do the job
easily. It's running with all default Squid settings except Cache RAM
which I've increased to 96Mb. There are no peer caches. I have checked
that there are no speed and duplex setting mismatches between the proxy
and firewall.
The squid proxy returns web pages approx. 2/3 slower than a direct
connection using the same link.
Can some-one please give me some simple steps to increase the speed of
the cache?
Thanks for any advice.





--
"Genius might be described as a supreme capacity for getting its possessors
into trouble of all kinds."
-- Samuel Butler


Re: [squid-users] Stability problems with diskd in Squid 2.6

2006-09-02 Thread Michał Margula

Anders Nordby wrote:

I am using diskd, with 5 cache dirs on each server (each dir containing
quite a lot of directories). If I turn off diskd and use plain ufs cache
dirs, the instabilitity problem goes away, but then the servers become
very slow to respond. :-( Which I/we can not live with. As 2.6 is
supposed to be faster than 2.5 because of kqueue, downgrading doesn't
seem like a good option either.


Funny thing. I had trouble with squid segfaulting in some versions with 
diskd. Now with 2.5stable13 it works fine. Maybe try this flavour.


BTW: does BSD have SMP-aware threads? if yes aufs should perform well 
(correct me if I am wrong anywhere).


--
Michał Margula, [EMAIL PROTECTED], http://alchemyx.uznam.net.pl/
"W życiu piękne są tylko chwile" [Ryszard Riedel]


RES: RES: [squid-users] Freebsd -Squid - danguardian- Winbind-XMallocError

2006-09-02 Thread Erick Dantas Rotole
 Henrik,

Thanks a lot. I will test and the send the results.


See you


-Mensagem original-
De: Henrik Nordstrom [mailto:[EMAIL PROTECTED] 
Enviada em: sexta-feira, 1 de setembro de 2006 11:47
Para: Erick Dantas Rotole
Cc: squid-users@squid-cache.org
Assunto: Re: RES: [squid-users] Freebsd -Squid - danguardian-
Winbind-XMallocError

On Fri, 2006-09-01 at 07:27 -0300, Erick Dantas Rotole wrote:
> Henrik,
> 
> I had already read the FAQ. But the configuration for FREEBSD I think 
> it is for older version.

Possible. The reasoning is the same.

>  Searching the web I found. 
> 
> add the following values to /boot/loader.conf which worked:
> kern.maxdsiz="1073741824" # 1GB
> kern.dfldsiz="1073741824" # 1GB
> kern.maxssiz="134217728" # 128MB
> 
> Is that rigth? I have to set kern.maxdsiz or kern.maxssiz. Thanks!


maxdsiz is the key parameter. Not sure if dfldsiz needs to be set.

you shoud not need to change massiz.

Regards
Henrik



Re: [squid-users] getting rid of 304's

2006-09-02 Thread Matus UHLAR - fantomas
On 01.09.06 15:05, Nick Duda wrote:
> We just put squid into play like this for a test we are doing. Prior to
> the test the client would hit the server directly for its pages. The web
> log showed the clients hits and downloading the pages, images...etc. We
> then put squid inbetween them, and the server no longer shows the client
> making the calls, sweet. It shows the proxy doing so, sweet.
> 
> The problem we are seeing is that the web server is showing a lot of
> 304's from the proxy , and the byte count in the log files for stuff
> like images are the full size, as if the proxy is still pulling from the
> server every couple seconds. What is misconfigured? We would like the
> iis servers log file to show the occasional hit for the pages/gif files
> from the proxy.

do you have correct time set up on server, proxy and clients?
Does the server return Expires: headers on those objects?
-- 
Matus UHLAR - fantomas, [EMAIL PROTECTED] ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
WinError #98652: Operation completed successfully.


Re: [squid-users] Forwarding loop?

2006-09-02 Thread Ralf Hildebrandt
* Visolve Squid <[EMAIL PROTECTED]>:

> >How can I prevent the internal stuff from being forwarded to the
> >parent_proxy?
 
> A forwarding loop is when a request passes through one proxy more than 
> once. You can get a forwarding loop if
> 
>* a cache forwards requests to itself. This might happen with
>  interception caching (or server acceleration) configurations.
>* a pair or group of caches forward requests to each other. This can
>  happen when Squid uses ICP, Cache Digests, or the ICMP RTT
>  database to select a next-hop cache.

I know, back to my question:

How can I prevent the internal stuff from being forwarded to the
parent_proxy?

-- 
Ralf Hildebrandt (i.A. des IT-Zentrums) [EMAIL PROTECTED]
Charite - Universitätsmedizin BerlinTel.  +49 (0)30-450 570-155
Gemeinsame Einrichtung von FU- und HU-BerlinFax.  +49 (0)30-450 570-962
IT-Zentrum Standort CBF send no mail to [EMAIL PROTECTED]


Re: [squid-users] reverse proxy v2.6

2006-09-02 Thread Visolve Squid

dale wilhelm wrote:


it appears that reverse proxy has been removed from the 2.6
version... does anyone know of a reason why this rm'd and if there is
a work around??? i have the following in my config for 2.5:

httpd_accel_host ( ip addr )
httpd_accel_port 8083
httpd_accel_single_host on
httpd_accel_with_proxy on

all httpd_accel* directives are now gone... any help would be


Hello Wilhelm,

Reverse proxy configuration for squid-2.6 can be done by using the 
following configuration in squid.conf.


http_port 80 vhost
cache_peer virtual parent [server listen port] 0 no-query originserver
http_access allow all

Thanks,
Visolve Squid Team
www.visolve.com/squid/


Re: [squid-users] Forwarding loop?

2006-09-02 Thread Visolve Squid

Ralf Hildebrandt wrote:


We're using a

intranet -> squid -> Dansguardian -> squid -> Internet
setup to filter the traffic for viruses

This must be the cause for this warning:

Aug 27 23:18:46 proxy-cvk-2 squid[27921]: WARNING: Forwarding loop detected 
for: Client: 127.0.0.1 http_port: 127.0.0.1: GET 
http://127.0.0.1/squid-internal-periodic/store_digest HTTP/1.0^M Accept: 
application/cache-digest^M Accept: text/html^M Host: 127.0.0.1:3129^M Via: 0.0 
wlan-proxy.charite.de:3128 (squid/2.6.STABLE3), 1.0 
proxy-cvk-2-nocache.charite.de: (squid/2.6.STABLE3)^M X-Forwarded-For: 
unknown, unknown, 127.0.0.1^M Cache-Control: max-age=259200^M Connection: 
keep-alive^M X-Forwarded-For: unknown, unknown, 127.0.0.1^M ^M
Aug 27 23:18:46 proxy-cvk-2 squid[27916]: temporary disabling (Not Found) 
digest from 127.0.0.1

How can I prevent the internal stuff from being forwarded to the
parent_proxy?


Hello Hildebrand,

A forwarding loop is when a request passes through one proxy more than 
once. You can get a forwarding loop if


   * a cache forwards requests to itself. This might happen with
 interception caching (or server acceleration) configurations.
   * a pair or group of caches forward requests to each other. This can
 happen when Squid uses ICP, Cache Digests, or the ICMP RTT
 database to select a next-hop cache.

Thanks,
Visolve Squid Team
www.visolve.com/squid/









[squid-users] Re: Stability problems with diskd in Squid 2.6

2006-09-02 Thread Adrian Chadd
On Sat, Sep 02, 2006, Anders Nordby wrote:
> Hi,
> 
> I am using Squid 2.6.STABLE3 in FreeBSD 6.1, on multiple servers running
> web acceleration. After upgrading to 2.6, Squid frequently dies on me in
> two different ways:
> 
> 2006/09/01 22:39:10| assertion failed: cbdata.c:359: "c->y ==
> CBDATA_COOKIE(p)"
> 
> 2006/09/01 22:41:14| assertion failed: diskd/store_io_diskd.c:387:
> "!diskdstate-
> >flags.close_request"

> Is there anyone else seeing this? Should I submit a bug report?

Please! Can you get a crashdump and a backtrace from these failures?



Adrian



Re: [squid-users] How to hide squid version information?

2006-09-02 Thread Visolve Squid

Monty Ree wrote:


Hello, all.

I would like to hide squid version or server information for security 
reason. So I set "via off" at squid.conf file. But via information is 
seen as ever.


Is there any directive or method like ServerTokens at apache?


Hello ,

Compile squid by altering the following line in squid source file 
src/errorpage.c.

Line:69: "Generated %T by %h (%s)\n"
In the above line %s denotes the squid version which can modified to the 
requirement.


Thanks,
Visolve Squid Team
http://www.visolve.com/squid/


[squid-users] Stability problems with diskd in Squid 2.6

2006-09-02 Thread Anders Nordby
Hi,

I am using Squid 2.6.STABLE3 in FreeBSD 6.1, on multiple servers running
web acceleration. After upgrading to 2.6, Squid frequently dies on me in
two different ways:

2006/09/01 22:39:10| assertion failed: cbdata.c:359: "c->y ==
CBDATA_COOKIE(p)"

2006/09/01 22:41:14| assertion failed: diskd/store_io_diskd.c:387:
"!diskdstate-
>flags.close_request"

I am using diskd, with 5 cache dirs on each server (each dir containing
quite a lot of directories). If I turn off diskd and use plain ufs cache
dirs, the instabilitity problem goes away, but then the servers become
very slow to respond. :-( Which I/we can not live with. As 2.6 is
supposed to be faster than 2.5 because of kqueue, downgrading doesn't
seem like a good option either.

Is there anyone else seeing this? Should I submit a bug report?

Cheers,

-- 
Anders.


Re: [squid-users] Access Denied (Newbie)

2006-09-02 Thread Visolve Squid

beno wrote:


Hi;
Here are what I believe are the pertinent lines from my squid.conf file:

cache_peer 2012.vi parent 7080 2020 default no-query
http_port 2020 vhost
acl all src 0.0.0.0/0.0.0.0
acl manager proto cache_object
acl localhost src 127.0.0.1/255.255.255.255
acl to_localhost dst 127.0.0.0/8
acl Safe_ports port 80 8080 7080 transparent  
where "2012.vi" is the name of the site, "7080" is the port to which 
Zope is listening for requests and "2020" is where squid is listening.
I want all requests for all pages on 2012 to be passed transparently 
to port 7080. When I surf to that page, however, I get a squid error 
stating that access is denied. However, before I passed this request 
through squid, I got no such error and the page was correctly served. 
Please help me understand what I've done wrong.

TIA,


Hello ,

Check your http_access rules in squid.conf.

Thanks,
Visolve Squid Team
http://www.visolve.com/squid/





[squid-users] need help squid very slow and all goes direct

2006-09-02 Thread squid learner
need help my cache is working fine as i wrote before 

but this one and + 3 i install for three difrent
places 

but fro last three days all stop working 

now it works very slow  if i give proxy of isp in
client  pc it is 10 time faster then my squid 

logs are showing 

1157190656.416576 192.168.1.18 TCP_MISS/000 0 GET
http://www.alfrasha.com/mem/alfrashalogo.gif? -
ROUNDROBIN_PARENT/cache7.ruh.isu.net.sa -
1157190656.418  13478 192.168.1.18 TCP_MISS/000 0 GET
http://reyada.akhbarak.net/title.gif? -
ROUNDROBIN_PARENT/cache7.ruh.isu.net.sa -
1157190657.071 20 192.168.1.18 TCP_IMS_HIT/304 216
GET http://www.numion.com/YourSpeed3/Results1.html -
NONE/- text/html
1157190657.075623 192.168.1.18 TCP_MISS/200 5252
GET http://www.numion.com/YourSpeed3/Save.php? -
ROUNDROBIN_PARENT/proxy.jeel.com text/html
1157190657.351 14 192.168.1.18 TCP_IMS_HIT/304 231
GET http://www.numion.com/YourSpeed3/MaxSpeedGraph.jar
- NONE/- application/octet-stream
1157190657.431 19 192.168.1.18 TCP_IMS_HIT/304 231
GET http://www.numion.com/YourSpeed3/Speedbar.jar -
NONE/- application/octet-stream
1157190657.482 30 192.168.1.18 TCP_IMS_HIT/304 232
GET http://www.numion.com/YourSpeed3/Speedbar.class -
NONE/- application/octet-stream
1157190657.641 19 192.168.1.18 TCP_IMS_HIT/304 231
GET http://www.numion.com/YourSpeed3/Graphs.jar -
NONE/- application/octet-stream
1157190658.268   1116 192.168.1.18 TCP_MISS/200 5279
GET http://pagead2.googlesyndication.com/pagead/ads? -
NONE/- text/html
1157190901.002 929480 192.168.1.18 TCP_MISS/504 1433
GET http://clip.6rb.com/a175.rm -
ANY_PARENT/cache7.ruh.isu.net.sa text/html
  
 
there is NONE/- or DIRECT/ are there 




__
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com 


Re: [squid-users] Squid 2/3 slower than direct access

2006-09-02 Thread Adrian Chadd
Hiya Greg,

please supply the configuration file. It'll let us see whats going on.




Adrian

On Sat, Sep 02, 2006, Greg Wilson wrote:
> I've installed Squid on a HP DL380 server with dual cpus, 2 Gb RAM and SCSI 
> raid 5. It's running on Debian Sarge with little extra load. I am using this 
> for our staff of around 100 and though this would do the job easily. It's 
> running with all default Squid settings except Cache RAM which I've increased 
> to 96Mb. There are no peer caches. I have checked that there are no speed and 
> duplex setting mismatches between the proxy and firewall.
>  
> The squid proxy returns web pages approx. 2/3 slower than a direct connection 
> using the same link.
>  
> Can some-one please give me some simple steps to increase the speed of the 
> cache?
>  
> Thanks for any advice.


[squid-users] Squid 2/3 slower than direct access

2006-09-02 Thread Greg Wilson
I've installed Squid on a HP DL380 server with dual cpus, 2 Gb RAM and SCSI 
raid 5. It's running on Debian Sarge with little extra load. I am using this 
for our staff of around 100 and though this would do the job easily. It's 
running with all default Squid settings except Cache RAM which I've increased 
to 96Mb. There are no peer caches. I have checked that there are no speed and 
duplex setting mismatches between the proxy and firewall.
 
The squid proxy returns web pages approx. 2/3 slower than a direct connection 
using the same link.
 
Can some-one please give me some simple steps to increase the speed of the 
cache?
 
Thanks for any advice.