[squid-users] hostname not determined automatically

2010-05-06 Thread Ralf Hildebrandt
I'm using the same squid3.conf on 4 proxies with differenz hostnames.
Back with 2.7 I didn't have to set 
visible_hostname
explicitly. Squid would just use the hostname of the machine it was
running on.

With squid-3.0.STABLE19 all the error pages contain localhost instead
of the machine's hostname:
"Erzeugt am Thu, 06 May 2010 07:26:42 GMT von localhost (squid/3.0.STABLE19)"

# hostname -a
proxy-cvk-1

So what's wrong here?

-- 
Ralf Hildebrandt
  Geschäftsbereich IT | Abteilung Netzwerk
  Charité - Universitätsmedizin Berlin
  Campus Benjamin Franklin
  Hindenburgdamm 30 | D-12203 Berlin
  Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962
  ralf.hildebra...@charite.de | http://www.charite.de



Re: [squid-users] hostname not determined automatically

2010-05-06 Thread Jeff Pang
2010/5/6 Ralf Hildebrandt :
> I'm using the same squid3.conf on 4 proxies with differenz hostnames.
> Back with 2.7 I didn't have to set
> visible_hostname
> explicitly. Squid would just use the hostname of the machine it was
> running on.
>

from my experience with squid-3.x, you need to set visible_hostname in
squid.conf distinctly.


-- 
Tech support agent in China
http://duxieweb.com/


Re: [squid-users] hostname not determined automatically

2010-05-06 Thread Ralf Hildebrandt
* Jeff Pang :
> 2010/5/6 Ralf Hildebrandt :
> > I'm using the same squid3.conf on 4 proxies with differenz hostnames.
> > Back with 2.7 I didn't have to set
> > visible_hostname
> > explicitly. Squid would just use the hostname of the machine it was
> > running on.
> >
> 
> from my experience with squid-3.x, you need to set visible_hostname in
> squid.conf distinctly.

Indeed this is the case.
I read Matus Uhlars similar bug reports :(

-- 
Ralf Hildebrandt
  Geschäftsbereich IT | Abteilung Netzwerk
  Charité - Universitätsmedizin Berlin
  Campus Benjamin Franklin
  Hindenburgdamm 30 | D-12203 Berlin
  Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962
  ralf.hildebra...@charite.de | http://www.charite.de



Re: [squid-users] SSH not working With Squid3.0

2010-05-06 Thread a...@gmail
I have tried to use their FQDN, have tried using their IP Addresses, have 
tried locally

connection refused whichever way I do it's the same problem.
Regards
Adam
- Original Message - 
From: "Nyamul Hassan" 

To: "Squid Users" 
Sent: Thursday, May 06, 2010 1:18 AM
Subject: Re: [squid-users] SSH not working With Squid3.0


Are you trying to do SSH to the servers using their FQDN? Or IP Address?

Regards
HASSAN



On Thu, May 6, 2010 at 02:31, a...@gmail  wrote:


Hi,
Yes I have searched why but could not find why not in the log not anywhere 
else.


Tried with Iptables, with router same thing.
How do I know?
Ok if I shut down the proxy machine and completely remove it from the 
network and try again absolutely no problems in connecting to all my ssh 
servers

but when I run the proxy server, the problem comes back how about that?

I know it is the proxy server, what I don't know is why?
Any ideas please?
Thanks
- Original Message - From: "John Doe" 
To: 
Sent: Wednesday, May 05, 2010 12:40 PM
Subject: Re: [squid-users] SSH not working With Squid3.0



From: "a...@gmail" 


even if I try internally to access the other machine's SSH
servers the connection is refused


Fix that first... Searched why it is refused?
And why do you say it is squid fault?

JD










Re: [squid-users] SSH not working With Squid3.0

2010-05-06 Thread John Doe
From: "a...@gmail" 
> Yes I have searched why but could not find why not in the log not 
> anywhere else.
> Tried with Iptables, with router same thing.
> How do I know?
> Ok if I shut down the proxy machine and completely remove it from the 
> network and try again absolutely no problems in connecting to all my ssh 
> serversbut when I run the proxy server, the problem comes back how about 
> that?
> I know it is the proxy server, what I don't know is why?

ok, so it is not a squid problem, but a server problem...
Tried ssh -v (or -vv, -vvv)?
What's the denied message in sshd logs?
If you don't describe your setup (topology, routing, iptables rules...), we can 
barely try to guess...

JD


  


Re: [squid-users] SSH not working With Squid3.0

2010-05-06 Thread Nyamul Hassan
Is their IP reachable from the host your are trying to access SSH?
Regards
HASSAN


On Thu, May 6, 2010 at 14:51, a...@gmail  wrote:
>
> I have tried to use their FQDN, have tried using their IP Addresses, have 
> tried locally
> connection refused whichever way I do it's the same problem.
> Regards
> Adam
> - Original Message - From: "Nyamul Hassan" 
> To: "Squid Users" 
> Sent: Thursday, May 06, 2010 1:18 AM
> Subject: Re: [squid-users] SSH not working With Squid3.0
>
>
> Are you trying to do SSH to the servers using their FQDN? Or IP Address?
>
> Regards
> HASSAN
>
>
>
> On Thu, May 6, 2010 at 02:31, a...@gmail  wrote:
>>
>> Hi,
>> Yes I have searched why but could not find why not in the log not anywhere 
>> else.
>>
>> Tried with Iptables, with router same thing.
>> How do I know?
>> Ok if I shut down the proxy machine and completely remove it from the 
>> network and try again absolutely no problems in connecting to all my ssh 
>> servers
>> but when I run the proxy server, the problem comes back how about that?
>>
>> I know it is the proxy server, what I don't know is why?
>> Any ideas please?
>> Thanks
>> - Original Message - From: "John Doe" 
>> To: 
>> Sent: Wednesday, May 05, 2010 12:40 PM
>> Subject: Re: [squid-users] SSH not working With Squid3.0
>>
>>
>>> From: "a...@gmail" 

 even if I try internally to access the other machine's SSH
 servers the connection is refused
>>>
>>> Fix that first... Searched why it is refused?
>>> And why do you say it is squid fault?
>>>
>>> JD
>>>
>>>
>>>
>>
>>
>
>


[squid-users] High latency through squid

2010-05-06 Thread Tomasz
Hello,
I have problem with latest squid versions.

Problem is high latency through squid. Numion.com surfspeed give 2x better 
results without squid ( I tested squid with and without cache_dir  option)


Server config:
8GB of RAM,
Intel(R) Core(TM)2 Duo CPU E6850  @ 3.00GHz
3x 40GB WD Raptor


My SQUID config:
access_log /var/log/squid/access.log squid
acl bad url_regex "/etc/squid/bad.url 
acl baza_danych src xx.xx.xx.xx/32   
acl CONNECT method CONNECT
acl localhost src 127.0.0.1/32 xx.xx.xx.xx/32
acl manager proto cache_object 
acl our_networks src xx.xx.xx.xx/24 xx.xx.xx.xx/24 xx.xx.xx.xx/24 
xx.xx.xx.xx/24 10.0.0.0/8
acl purge method PURGE  
  
acl QUERY urlpath_regex cgi-bin \?  
  
acl QUERY urlpath_regex cgi-bin \?  
  
acl Safe_ports port 1025-65535  # unregistered ports
  
acl Safe_ports port 21  # ftp   
  
acl Safe_ports port 210 # wais  
  
acl Safe_ports port 280 # http-mgmt 
  
acl Safe_ports port 443 # https 
  
acl Safe_ports port 488 # gss-http  
  
acl Safe_ports port 591 # filemaker 
  
acl Safe_ports port 70  # gopher
  
acl Safe_ports port 777 # multiling http
  
acl Safe_ports port 80  # http  
  
acl Safe_ports port 901 # SWAT  
  
acl SSL_ports port 443  
  
acl to_localhost dst 127.0.0.0/8
  
acl zabronione dstdomain www.pogodynka.pl www.google.pl www.google.com  
  
buffered_logs on
  
cache deny QUERY
  
cache deny QUERY
  
cache deny zabronione   
  
cache_dir aufs /var/cache/squid/dysk1 8000 16 256   
  
cache_dir aufs /var/cache/squid/dysk2 8000 16 256   
  
cache_dir aufs /var/cache/squid/dysk3 8000 16 256   
  
cache_log /var/log/squid/cache.log  
  
cache_mem 3500 MB   
  
cache_mgr ad...@abp.pl  
  
cache_replacement_policy lru
  
cache_store_log none
  
cache_swap_high 97  
  
cache_swap_low 92   
  
client_db off   
  
coredump_dir none   
  
error_directory /usr/share/squid/errors/pl  
  
forwarded_for on
  
half_closed_clients on  
  
hierarchy_stoplist cgi-bin ?
  
http_access allow manager our_networks  
  
http_access allow our_networks  
  
http_access allow purge localhost   
  
http_access deny all
  
http_access deny bad
http_access deny CONNECT !SSL_ports
http_access deny localhost
http_access deny manager localhost
http_access deny purge
http_access deny !Safe_ports
http_port 82.160.202.14:3128 transparent
icp_access allow all
logfile_rotate 30
maximum_object_size 3 KB
maximum_object_size_in_memory 128 KB
max_open_disk_fds 32768
memory_pools off
memory_replacement_policy lru
p

[squid-users] Increasing File Descriptors

2010-05-06 Thread Bradley, Stephen W. Mr.
I can't seem to get increase the number above 32768 no matter what I do.

Ulimit during compile, sysctl.conf and everything else but no luck.


I have about 5,000 users on a 400mbit connection.

Steve

RHEL5 64bit with Squid 3.1.1

Re: [squid-users] Increasing File Descriptors

2010-05-06 Thread Ivan .
worked for me

http://paulgoscicki.com/archives/2007/01/squid-warning-your-cache-is-running-out-of-filedescriptors/

no recompile necessary


On Thu, May 6, 2010 at 7:13 PM, Bradley, Stephen W. Mr.
 wrote:
> I can't seem to get increase the number above 32768 no matter what I do.
>
> Ulimit during compile, sysctl.conf and everything else but no luck.
>
>
> I have about 5,000 users on a 400mbit connection.
>
> Steve
>
> RHEL5 64bit with Squid 3.1.1


Re: [squid-users] High latency through squid

2010-05-06 Thread Amos Jeffries

Tomasz wrote:

Hello,
I have problem with latest squid versions.


Which "latest"?
 'tis very flexible.



Problem is high latency through squid. Numion.com surfspeed give 2x better 
results without squid ( I tested squid with and without cache_dir  option)



Server config:
8GB of RAM,
Intel(R) Core(TM)2 Duo CPU E6850  @ 3.00GHz
3x 40GB WD Raptor


My SQUID config:
access_log /var/log/squid/access.log squid
acl bad url_regex "/etc/squid/bad.url 
acl baza_danych src xx.xx.xx.xx/32   
acl CONNECT method CONNECT
acl localhost src 127.0.0.1/32 xx.xx.xx.xx/32
acl manager proto cache_object 
acl our_networks src xx.xx.xx.xx/24 xx.xx.xx.xx/24 xx.xx.xx.xx/24 
xx.xx.xx.xx/24 10.0.0.0/8
acl purge method PURGE
acl QUERY urlpath_regex cgi-bin \?
acl QUERY urlpath_regex cgi-bin \?
acl Safe_ports port 1025-65535  # unregistered ports  
acl Safe_ports port 21  # ftp 
acl Safe_ports port 210 # wais
acl Safe_ports port 280 # http-mgmt   
acl Safe_ports port 443 # https   
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker   
acl Safe_ports port 70  # gopher  
acl Safe_ports port 777 # multiling http  
acl Safe_ports port 80  # http
acl Safe_ports port 901 # SWAT
acl SSL_ports port 443
acl to_localhost dst 127.0.0.0/8  
acl zabronione dstdomain www.pogodynka.pl www.google.pl www.google.com
buffered_logs on  
cache deny QUERY  
cache deny QUERY  
cache deny zabronione 
cache_dir aufs /var/cache/squid/dysk1 8000 16 256 
cache_dir aufs /var/cache/squid/dysk2 8000 16 256 
cache_dir aufs /var/cache/squid/dysk3 8000 16 256 
cache_log /var/log/squid/cache.log
cache_mem 3500 MB 
cache_mgr ad...@abp.pl
cache_replacement_policy lru  
cache_store_log none  
cache_swap_high 97
cache_swap_low 92 
client_db off 
coredump_dir none 
error_directory /usr/share/squid/errors/pl
forwarded_for on  
half_closed_clients on
hierarchy_stoplist cgi-bin ?  
http_access allow manager our_networks
http_access allow our_networks
http_access allow purge localhost 
http_access deny all  
http_access deny bad

http_access deny CONNECT !SSL_ports
http_access deny localhost
http_access deny manager localhost
http_access deny purge
http_access deny !Safe_ports
http_port 82.160.202.14:3128 transparent
icp_access allow all
logfile_rotate 30
maximum_object_size 3 KB
maximum_object_size_in_memory 128 KB
max_open_disk_fds 32768
memory_pools off
memory_replac

Re: [squid-users] High latency through squid

2010-05-06 Thread Tomasz
Dnia czwartek 06 maj 2010 o 11:26:56 Amos Jeffries napisał(a):
> Tomasz wrote:
> > Hello,
> > I have problem with latest squid versions.
>
> Which "latest"?
>   'tis very flexible.
3.0+ and 3.1+

Few months ago I used squid 2.7.

Regards,
-- 
Tomasz


Re: [squid-users] High latency through squid

2010-05-06 Thread Nyamul Hassan
For forward proxy configuration, Squid 2.7 still offers the best
overall performance.

Regards
HASSAN



2010/5/6 Tomasz :
> Dnia czwartek 06 maj 2010 o 11:26:56 Amos Jeffries napisał(a):
>> Tomasz wrote:
>> > Hello,
>> > I have problem with latest squid versions.
>>
>> Which "latest"?
>>   'tis very flexible.
> 3.0+ and 3.1+
>
> Few months ago I used squid 2.7.
>
> Regards,
> --
> Tomasz
>
>


Re: [squid-users] High latency through squid

2010-05-06 Thread Tomasz
Dnia czwartek 06 maj 2010 o 11:39:08 napisałeś:
> For forward proxy configuration, Squid 2.7 still offers the best
> overall performance.
>
So I should back to Squid 2.7 for transparent forward proxy configuration best 
performance?

Regards,
-- 
Tomasz


Re: [squid-users] SSH not working With Squid3.0

2010-05-06 Thread a...@gmail

Hi,
Yes, I can ping their IPs
They are reachable internally and externally
The reason I am asking here hoping that someone had a similar problem in the 
past who might be able to help
Or perhaps something I need to do with the Squid's config in order to 
successfully reach these SSH servers.


Logically speaking, Squid should not interfer with SSH connections, should 
it?

But in my case I know it does.
The only SSH I can access internally or externally is the SSH server that is 
running on the same box as Squid


Regards
Adam

- Original Message - 
From: "Nyamul Hassan" 

To: "Squid Users" 
Sent: Thursday, May 06, 2010 10:01 AM
Subject: Re: [squid-users] SSH not working With Squid3.0



Is their IP reachable from the host your are trying to access SSH?
Regards
HASSAN


On Thu, May 6, 2010 at 14:51, a...@gmail  wrote:


I have tried to use their FQDN, have tried using their IP Addresses, have 
tried locally

connection refused whichever way I do it's the same problem.
Regards
Adam
- Original Message - From: "Nyamul Hassan" 
To: "Squid Users" 
Sent: Thursday, May 06, 2010 1:18 AM
Subject: Re: [squid-users] SSH not working With Squid3.0


Are you trying to do SSH to the servers using their FQDN? Or IP Address?

Regards
HASSAN



On Thu, May 6, 2010 at 02:31, a...@gmail  wrote:


Hi,
Yes I have searched why but could not find why not in the log not 
anywhere else.


Tried with Iptables, with router same thing.
How do I know?
Ok if I shut down the proxy machine and completely remove it from the 
network and try again absolutely no problems in connecting to all my ssh 
servers

but when I run the proxy server, the problem comes back how about that?

I know it is the proxy server, what I don't know is why?
Any ideas please?
Thanks
- Original Message - From: "John Doe" 
To: 
Sent: Wednesday, May 05, 2010 12:40 PM
Subject: Re: [squid-users] SSH not working With Squid3.0



From: "a...@gmail" 


even if I try internally to access the other machine's SSH
servers the connection is refused


Fix that first... Searched why it is refused?
And why do you say it is squid fault?

JD













Re: [squid-users] SSH not working With Squid3.0

2010-05-06 Thread a...@gmail

Ok I'll try and describe it the best I can.

I have a router LinkSys/Cisco

This is how it goes:

Internet > [ISP-Modem]   (LocalNetwork )

Local Network > Machine1 Machine2  Machine3 Machine4 Machine5 Machine6

Machine1 = SQUID3.0
Machine2= Mail-Server
Machine3= Webserver1
Machine4= Webserver2
Machine5=DSN server
Machine6= Other services (Chat server)

And 3 Windows Clients

In All There are 9 Machines



I can access these machines except via SSH
Even though I have forwarded requests to each machine's SSH port


Now for the errors
When I try internally to connect to any of the SSH servers I get this error

Let's say the only accessible SSH is the one running on the Squid's machine 
it has a port number , ok?


Now if I want to ssh machine 192.168.1.3 on port 2224
ssh 192.168.1.3 2224

I get the following

connect to host 192.168.1.3 port : Connection refused

Do you see what I mean even though I do specify the port number of the 
machine which in this case is the port 2224
But I get the error message replying with the Squid's port number , and 
that is regardless from which machine I am trying to send the SSH request


And from outside

I get "Network Error Connection refused" if I try with putty for example:

But if I turn off Squid's machine and unplug it from the network, I have 
absolutely no problem accessing these servers.


Very strange

Regards
Adam







- Original Message - 
From: "John Doe" 

To: 
Sent: Thursday, May 06, 2010 9:55 AM
Subject: Re: [squid-users] SSH not working With Squid3.0



From: "a...@gmail" 

Yes I have searched why but could not find why not in the log not
anywhere else.
Tried with Iptables, with router same thing.
How do I know?
Ok if I shut down the proxy machine and completely remove it from the
network and try again absolutely no problems in connecting to all my ssh
serversbut when I run the proxy server, the problem comes back how about
that?
I know it is the proxy server, what I don't know is why?


ok, so it is not a squid problem, but a server problem...
Tried ssh -v (or -vv, -vvv)?
What's the denied message in sshd logs?
If you don't describe your setup (topology, routing, iptables rules...), 
we can barely try to guess...


JD







Re: [squid-users] Squid 2.7 without signature

2010-05-06 Thread marcus
On Wednesday 05 May 2010 19:31:37 you wrote:
> It requires patching the source; see errorpage.c, look for
> 'ERR_SQUID_SIGNATURE'.
> 

I running squid in Debian Lenny system. I made my squid installation from 
debian repositories, not source files. So, I didn't found errorpage.c and 
ERR_SQUID_SIGNATURE file.


> I'd support making it possible to suppress this (or turn it into an HTML
> comment, as I've done) via configuration.
> 

How?

Anyway, At moment, showing my squid version for my clients isn't a big deal.

BTW, a upgrade to squid3 fix it. Doesn't it?

> Cheers,

Thanks for reply.


> 
> On 05/05/2010, at 10:14 PM, marcus wrote:
> > Hi,
> > 
> > Due a security reasons, I would like my default page error without the
> > squid signature.
> > I already could custom my error page and display it but I don't know how
> > to remove the signature of page bottom.
> > 
> > Is it possible? The best I could make was a short signature using %s tag.
> > 
> > Regards,
> > Marcus D
> 
> --
> Mark Nottingham   m...@yahoo-inc.com



RE: [squid-users] Best policy to allow only proxy surfing

2010-05-06 Thread Boniforti Flavio
Hello Glenn,

[cut]

> > Good luck, but still I confess that I *may be* switching to 
> this your 
> > suggestion too! ;-)
> 
> Use default deny and break up the logic into chains (within 
> reason). Makes things a lot easier to maintain. Did for me, anyway.

glad to share some thoughts... We will eventually re-discuss issues on
this list ;-)

Regards,
Flavio Boniforti

PIRAMIDE INFORMATICA SAGL
Via Ballerini 21
6600 Locarno
Switzerland
Phone: +41 91 751 68 81
Fax: +41 91 751 69 14
URL: http://www.piramide.ch
E-mail: fla...@piramide.ch 


Re: [squid-users] SSH not working With Squid3.0

2010-05-06 Thread John Doe
From: "a...@gmail" 
> Internet > [ISP-Modem]   (LocalNetwork )
> Local Network > Machine1 Machine2  Machine3 Machine4 Machine5 Machine6
> Machine1 = SQUID3.0
> Machine2= Mail-Server
> ...
> I can access these machines except via SSH
> Even though I have forwarded requests to each machine's SSH port

Forwarded requests?
We were talking about local sshing... right?
Why would you forward, how, and from where to where?
Are you talking about ssh from the Internet to the local network, through the 
firewall?
I did ask if local ssh was working...  Is it?
If you go on a local machine and try to ssh to another local machine, does it 
work?

> Do you see what I mean even though I do specify the port number 
> of the machine which in this case is the port 2224
> But I get the error message replying with the Squid's port number , 
> and that is regardless from which machine I am trying to send the SSH request

No, I don't understand how this squid server would magicaly capture all the 
packets...
If from machine A I try to ssh to machine B, the packet will go to machine B 
directly.
Unless I am wrong, it will only go through the gateway if the target IP network 
is different.
We still miss information, like routing, forwarding rules, etc...
try to follow the packets routes.
Maybe you will need to look at tcpdumps...

JD


  


Re: [squid-users] SSH not working With Squid3.0

2010-05-06 Thread Jakob Curdes


But if I turn off Squid's machine and unplug it from the network, I 
have absolutely no problem accessing these servers.


What happens if you just shutdown the squid service? Does the strange 
behavior remain or vanish?


JC


Re: [squid-users] SSH not working With Squid3.0

2010-05-06 Thread a...@gmail


- Original Message - 
From: "John Doe" 

To: 
Sent: Thursday, May 06, 2010 3:04 PM
Subject: Re: [squid-users] SSH not working With Squid3.0



From: "a...@gmail" 

Internet > [ISP-Modem]   (LocalNetwork )
Local Network > Machine1 Machine2  Machine3 Machine4 Machine5 Machine6
Machine1 = SQUID3.0
Machine2= Mail-Server
...
I can access these machines except via SSH
Even though I have forwarded requests to each machine's SSH port


Forwarded requests?
We were talking about local sshing... right?
Why would you forward, how, and from where to where?
Are you talking about ssh from the Internet to the local network, through 
the firewall?

I did ask if local ssh was working...  Is it?
If you go on a local machine and try to ssh to another local machine, does 
it work?


I was talking about both from the internet and the local Network
I did explain that from the local if I do

ssh 192.168.1.6  on port 2224
I get the error message
ssh host 192.168.1.6 port  connection refused

And the port  is the port of the machine on which the proxy server runs

it doesn't matter from which machine I am trying to ssh another machine
I get the same error message:

As if my entire network is locked into one ssh port and that is the ssh  
which also runs the router









Do you see what I mean even though I do specify the port number
of the machine which in this case is the port 2224
But I get the error message replying with the Squid's port number ,
and that is regardless from which machine I am trying to send the SSH 
request


No, I don't understand how this squid server would magicaly capture all 
the packets...
If from machine A I try to ssh to machine B, the packet will go to machine 
B directly.
Unless I am wrong, it will only go through the gateway if the target IP 
network is different.

We still miss information, like routing, forwarding rules, etc...
try to follow the packets routes.
Maybe you will need to look at tcpdumps...


Yes normally when you ssh a machine internally you don't need rerouting or 
forwarding
I am not saying I have forwarded the internal requests, I forwarded requests 
coming from the internet

for instance using clients such as putty etc..

But no connection is allowed either internally or externally.

I hope that helps


JD

Regards

Adam






[squid-users] squid in load balanced wccpv2 configuration

2010-05-06 Thread Jiffy 1111
Hi, all,

In a nutshell, I am trying to install squid as a third proxy to alleviate some 
pressure from our two Bluecoat proxies into a currently working wccpv2 
configuration.
We now have 5000+ users.

My current squid configuration works perfectly fine in explicit mode.
The problem I am having, is that squid can't seem to join the wccp service 
groups.
I've tried the configuration examples from 
http://wiki.squid-cache.org/ConfigExamples/ to no avail.

We have two Cisco 6513's in our core and we are using wccp to load balance 
between the proxies.

I'm posting my sanitized configs hoping someone can shed some light on this and 
show me what my squid.conf, iptables and network interfaces should look like.
I would also appreciate any recommended settings for memory and disk use based 
on the hardware spec I am posting. This server will be dedicated to squid.

Server:
cat /etc/redhat-release
Fedora release 12 (Constantine)

rpm -qa squid
squid-3.1.1-1.fc12.i686

4 x Intel(R) Xeon(R) CPU 5160  @ 3.00GHz

free -m
 total
Mem: 7991 

600 Gig on /var

ip tunnel add wccp1 mode gre remote x.x.0.1 local x.x.1.77 dev eth0
ifconfig wccp1 inet x.x.1.76 netmask 255.255.255.192 up

ifconfig
eth0
inet addr:x.x.1.77  Bcast:x.x.1.127  Mask:255.255.255.192

wccp1
inet addr:x.x.1.76  P-t-P:x.x.1.76  Mask:255.255.255.192

iptables:
echo 1 > /proc/sys/net/ipv4/ip_forward
echo 0 > /proc/sys/net/ipv4/conf/default/rp_filter
echo 0 > /proc/sys/net/ipv4/conf/all/rp_filter
echo 0 > /proc/sys/net/ipv4/conf/eth0/rp_filter
echo 0 > /proc/sys/net/ipv4/conf/eth1/rp_filter
echo 0 > /proc/sys/net/ipv4/conf/lo/rp_filter
echo 0 > /proc/sys/net/ipv4/conf/gre0/rp_filter
iptables -F -t nat
iptables -t nat -A PREROUTING -i wccp1 -p tcp -m tcp --dport 80 -j DNAT 
--to-destination x.x.1.77:5
iptables -t nat -A PREROUTING -i wccp1 -p tcp -m tcp --dport 20 -j DNAT 
--to-destination x.x.1.77:20
iptables -t nat -A PREROUTING -i wccp1 -p tcp -m tcp --dport 21 -j DNAT 
--to-destination x.x.1.77:21
iptables -t nat -A PREROUTING -i wccp1 -p tcp -m tcp --dport 443 -j DNAT 
--to-destination x.x.1.77:443
iptables -t nat -A PREROUTING -i wccp1 -p tcp -m tcp --dport 1755 -j DNAT 
--to-destination x.x.1.77:1755
iptables -t nat -A PREROUTING -i wccp1 -p tcp -m tcp --dport 7070 -j DNAT 
--to-destination x.x.1.77:7070

from server:
ping -c 4 x.x.0.1
PING x.x.0.1 (x.x.0.1) 56(84) bytes of data.
64 bytes from x.x.0.1: icmp_seq=1 ttl=255 time=0.396 ms
64 bytes from x.x.0.1: icmp_seq=2 ttl=255 time=0.363 ms
64 bytes from x.x.0.1: icmp_seq=3 ttl=255 time=0.298 ms
64 bytes from x.x.0.1: icmp_seq=4 ttl=255 time=0.283 ms

ping -c 4 x.x.0.2
PING x.x.0.2 (x.x.0.2) 56(84) bytes of data.
64 bytes from x.x.0.2: icmp_seq=1 ttl=255 time=3.20 ms
64 bytes from x.x.0.2: icmp_seq=2 ttl=255 time=3.06 ms
64 bytes from x.x.0.2: icmp_seq=3 ttl=255 time=3.33 ms
64 bytes from x.x.0.2: icmp_seq=4 ttl=255 time=3.19 ms

squid.conf:
acl manager proto cache_object
acl localhost src 127.0.0.1/32
acl localhost src ::1/128
acl to_localhost dst 127.0.0.0/8 0.0.0.0/32
acl to_localhost dst ::1/128

acl localnet src fc00::/7   # RFC 4193 local private network range
acl localnet src fe80::/10  # RFC 4291 link-local (directly plugged) machines
acl localnet src x.x.0.0/16 # Our network

acl SSL_ports port 443  # SSL
acl SSL_ports port 8082 # Bluecoat administration
acl SSL_ports port 9443 # Websense administration
acl SSL_ports port 81   # alternate https
acl SSL_ports port 81   # alternate http

acl Safe_ports port 80  # http
acl Safe_ports port 20  # ftp
acl Safe_ports port 21  # ftp
acl Safe_ports port 443 # https
acl Safe_ports port 70  # gopher
acl Safe_ports port 210 # wais
acl Safe_ports port 1025-65535  # unregistered ports
acl Safe_ports port 280 # http-mgmt
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker
acl Safe_ports port 777 # multiling http
acl Safe_ports port 8080# Alternate http
acl Safe_ports port 8000# Alternate http
acl Safe_ports port 7070# Streaming

acl CONNECT method CONNECT

acl donotscan dstdomain .yahoo.com
acl donotscan dstdomain .google.com
acl donotscan dstdomain .microsoft.com

http_access allow manager localhost

http_access deny manager
http_access deny !Safe_ports
http_access deny CONNECT !SSL_ports

http_access allow localnet
http_access allow localhost

http_access deny all

http_port x.x.1.77:5 transparent vport=80
http_port x.x.1.77:443 transparent vport=443
http_port x.x.1.77:20 transparent vport=20
http_port x.x.1.77:21 transparent vport=21
http_port x.x.1.77:1755 transparent vport=1755
http_port x.x.1.77:7070 transparent vport=7070

hierarchy_stoplist cgi-bin ?

coredump_dir /var/spool/squid

refresh_pattern ^ftp:   144020% 10080
refresh_pattern ^gopher:14400%  1440
refresh_pattern -i (/cgi-bin/|\?) 0 0%  0
refresh_pattern .   0   20

[squid-users] TCP_MISS/000 0 POST

2010-05-06 Thread Nick Cairncross
Hi,

I have a TCP_MISS 000 error being reported for users in the 172.16.0.0 subnet 
attempting to upload files to a particular internet site. I understand that 000 
indicates that the request has been aborted before it could complete? The exact 
error is:

TCP_MISS/000 0 POST http://[domain removed ]/fileuploads? - DIRECT/domain 
removed

I have also tried sending direct via the Squid to no avail - if I bypass the 
Squid entirely it works ok.

Any help gratefully received!

Nick
---
My squid conf is:

http_port vh-squid1:8080
auth_param negotiate program /usr/lib/squid/squid_kerb_auth -r
auth_param negotiate children 10
auth_param negotiate keep_alive on

auth_param ntlm program /usr/bin/ntlm_auth --helper-protocol=squid-2.5-ntlmssp
auth_param ntlm children 40

auth_param basic program /usr/bin/ntlm_auth --helper-protocol=squid-2.5-basic
auth_param basic children 5
auth_param basic realm Squid proxy-caching web server
auth_param basic credentialsttl 2 hours

cache_peer [upstreamserver] parent 8080 0 no-query proxy-only no-digest default

icap_enable on
icap_preview_enable on
icap_persistent_connections on
icap_send_client_ip on
icap_send_client_username on
icap_client_username_header X-Authenticated-User
icap_client_username_encode on
icap_service ss reqmod_precache 0 icap://localhost/ssreqmod
icap_class c1 ss
icap_access c1 allow all

access_log /var/log/squid/access.log squid
cache_log /var/log/squid/cache.log
useragent_log /var/log/squid/useragent.log

delay_pools 1
delay_class 1 4
delay_parameters 1 -1/-1 -1/-1 -1/-1 400/400

acl Java_jvm browser "/etc/squid/ACL/USERAGENTS/USER-AGENTS_JAVA.txt"
acl iTunes browser "/etc/squid/ACL/USERAGENTS/USER-AGENTS_APPLE.txt"
acl MSNMessenger browser "/etc/squid/ACL/USERAGENTS/USER-AGENTS_MSN.txt"
acl AuthenticatedUsers proxy_auth REQUIRED
acl URL_ALLOWDstDomains dstdomain "/etc/squid/ACL/URL/URL_ALLOWDstDomains.txt"
acl CNP_172SUBNETS src 172.16.0.0/255.255.0.0
acl CNP_SERVERSUBNETS src 172.16.10.0/255.255.255.0
acl StopDirectIP url_regex ^[0-9]+\.[0-9]+\.[0-9]+\.[0-9]+
acl IP_MSNMessenger src "/etc/squid/ACL/IPADDRESSES/IP_MSNMESSENGER.txt"
acl SENDDIRECT_DstDomains dstdomain 
"/etc/squid/ACL/SENDDIRECT/SENDDIRECT_DSTDOMAINS.txt"
acl SENDDIRECT_IPAddresses src 
"/etc/squid/ACL/SENDDIRECT/SENDDIRECT_IPADDRESSES.txt"
acl IP_CONNECTALLOW src "/etc/squid/ACL/IPADDRESSES/IP_CONNECTALLOW.txt"
acl localhost src 127.0.0.1/255.255.255.255
acl to_localhost dst 127.0.0.0/8

acl SSL_ports port 443
acl Safe_ports port 80  # http
acl Safe_ports port 8080# http
acl Safe_ports port 21  # ftp
acl Safe_ports port 443 # https
acl Safe_ports port 70  # gopher
acl Safe_ports port 70  # gopher
acl Safe_ports port 210 # wais
acl Safe_ports port 1025-65535  # unregistered ports
acl Safe_ports port 280 # http-mgmt
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker
acl Safe_ports port 777 # multiling http
acl RTMP_ports port 1935# RTMP

acl CONNECT method CONNECT
acl POST method POST

http_access deny !Safe_ports
http_access deny MSNMessenger CNP_172SUBNETS !IP_MSNMESSENGER
http_access deny StopDirectIP !IP_CONNECTALLOW
http_access deny CONNECT !SSL_Ports !CNP_172SUBNETS
http_access deny POST !SSL_Ports !RTMP_ports !CNP_172SUBNETS
http_access deny iTunes !CNP_172SUBNETS
http_access deny Java_jvm !CNP_172SUBNETS

http_access allow CONNECT CNP_172SUBNETS
http_access allow POST CNP_172SUBNETS
http_access allow iTunes CNP_172SUBNETS
http_access allow Java_jvm CNP_172SUBNETS
http_access allow URL_ALLOWDstDomains

http_access allow AuthenticatedUsers
always_direct allow SENDDIRECT_DstDomains
always_direct allow SENDDIRECT_IPAddresses
http_access allow localhost

delay_access 1 allow AuthenticatedUsers !CNP_SERVERSUBNETS
delay_access 1 deny all

http_access deny to_localhost
never_direct allow all
snmp_access deny CNP_172SUBNETS
cache deny all
http_access deny all












** Please consider the environment before printing this e-mail **

The information contained in this e-mail is of a confidential nature and is 
intended only for the addressee.  If you are not the intended addressee, any 
disclosure, copying or distribution by you is prohibited and may be unlawful.  
Disclosure to any party other than the addressee, whether inadvertent or 
otherwise, is not intended to waive privilege or confidentiality.  Internet 
communications are not secure and therefore Conde Nast does not accept legal 
responsibility for the contents of this message.  Any views or opinions 
expressed are those of the author.

Company Registration details:
The Conde Nast Publications Ltd
Vogue House
Hanover Square
London W1S 1JU

Registered in London No. 226900


Re: [squid-users] SSH not working With Squid3.0

2010-05-06 Thread Jakob Curdes

Even though I have forwarded requests to each machine's SSH port


What exactly does that mean?

Yes normally when you ssh a machine internally you don't need 
rerouting or forwarding
I am not saying I have forwarded the internal requests, I forwarded 
requests coming from the internet

for instance using clients such as putty etc..

But no connection is allowed either internally or externally.
Well, you can forward the official SSH port 22 only once to one of the 
internal machines.
I am pretty sure there is some error in your port forwarding setup. To 
prove this, try to stop squid (not the whole server, just the squid 
process) and re-check ssh access. If the problems remain, you have an 
error in your firewalling/forwarding/gateway setup.


JC


RE: [squid-users] Increasing File Descriptors

2010-05-06 Thread Bradley, Stephen W. Mr.
Unfortunately won't work for me above 32768.

I have the ulimit in the startup script and that works okay but I need more the 
32768.

:-(



-Original Message-
From: Ivan . [mailto:ivan...@gmail.com] 
Sent: Thursday, May 06, 2010 5:17 AM
To: Bradley, Stephen W. Mr.
Cc: squid-users@squid-cache.org
Subject: Re: [squid-users] Increasing File Descriptors

worked for me

http://paulgoscicki.com/archives/2007/01/squid-warning-your-cache-is-running-out-of-filedescriptors/

no recompile necessary


On Thu, May 6, 2010 at 7:13 PM, Bradley, Stephen W. Mr.
 wrote:
> I can't seem to get increase the number above 32768 no matter what I do.
>
> Ulimit during compile, sysctl.conf and everything else but no luck.
>
>
> I have about 5,000 users on a 400mbit connection.
>
> Steve
>
> RHEL5 64bit with Squid 3.1.1


Re: [squid-users] Increasing File Descriptors

2010-05-06 Thread George Herbert
Do this:

ulimit -Hn

If the values is 32768 that's your current kernel/sys max value and
you're stuck.

If it's more than 32768 (and my RHEL 5.3 box says 65536) then you
should be able to increase up to that value.  Unless there's an
internal signed 16-bit int involved in FD tracking inside the Squid
code then something curious is happening...

However - I'm curious as to why you'd need that many.  I've had top
end systems with Squid clusters running with compiles of 16k file
descriptors and only ever really used 4-5k.  What are you doing that
you need more than 32k?


-george

On Thu, May 6, 2010 at 10:32 AM, Bradley, Stephen W. Mr.
 wrote:
> Unfortunately won't work for me above 32768.
>
> I have the ulimit in the startup script and that works okay but I need more 
> the 32768.
>
> :-(
>
>
>
> -Original Message-
> From: Ivan . [mailto:ivan...@gmail.com]
> Sent: Thursday, May 06, 2010 5:17 AM
> To: Bradley, Stephen W. Mr.
> Cc: squid-users@squid-cache.org
> Subject: Re: [squid-users] Increasing File Descriptors
>
> worked for me
>
> http://paulgoscicki.com/archives/2007/01/squid-warning-your-cache-is-running-out-of-filedescriptors/
>
> no recompile necessary
>
>
> On Thu, May 6, 2010 at 7:13 PM, Bradley, Stephen W. Mr.
>  wrote:
>> I can't seem to get increase the number above 32768 no matter what I do.
>>
>> Ulimit during compile, sysctl.conf and everything else but no luck.
>>
>>
>> I have about 5,000 users on a 400mbit connection.
>>
>> Steve
>>
>> RHEL5 64bit with Squid 3.1.1
>



-- 
-george william herbert
george.herb...@gmail.com


Re: [squid-users] Increasing File Descriptors

2010-05-06 Thread Nyamul Hassan
He needs more FDs because this single box is handling 5000 users over
a 400mbps connection.  We run around 2,000 users on generic hardware,
and have seen FDs as high as 20k.

We use CentOS 5 and the following guide is a good place to increase
the FD limit:
http://www.cyberciti.biz/faq/linux-increase-the-maximum-number-of-open-files/
The command "cat /proc/sys/fs/file-max" shows how many maximum FDs
your OS can handle.

After you've made sure that your OS is doing your desired FD limit,
please re-run Squid.  Squid shows how many FDs it is configured for in
its "General Runtime Information" (mgr:info in cli) from the CacheMgr
interface.  If this still shows lower than the OS limit you just saw
earlier, then you might need to recompile Squid with the
'--with-maxfd=' flag set during "./configure"

As a side note, if you are using Squid as a forward proxy, you might
have better results with Squid 2.7x.

Regards
HASSAN


On Fri, May 7, 2010 at 00:53, George Herbert  wrote:
>
> Do this:
>
> ulimit -Hn
>
> If the values is 32768 that's your current kernel/sys max value and
> you're stuck.
>
> If it's more than 32768 (and my RHEL 5.3 box says 65536) then you
> should be able to increase up to that value.  Unless there's an
> internal signed 16-bit int involved in FD tracking inside the Squid
> code then something curious is happening...
>
> However - I'm curious as to why you'd need that many.  I've had top
> end systems with Squid clusters running with compiles of 16k file
> descriptors and only ever really used 4-5k.  What are you doing that
> you need more than 32k?
>
>
> -george
>
> On Thu, May 6, 2010 at 10:32 AM, Bradley, Stephen W. Mr.
>  wrote:
> > Unfortunately won't work for me above 32768.
> >
> > I have the ulimit in the startup script and that works okay but I need more 
> > the 32768.
> >
> > :-(
> >
> >
> >
> > -Original Message-
> > From: Ivan . [mailto:ivan...@gmail.com]
> > Sent: Thursday, May 06, 2010 5:17 AM
> > To: Bradley, Stephen W. Mr.
> > Cc: squid-users@squid-cache.org
> > Subject: Re: [squid-users] Increasing File Descriptors
> >
> > worked for me
> >
> > http://paulgoscicki.com/archives/2007/01/squid-warning-your-cache-is-running-out-of-filedescriptors/
> >
> > no recompile necessary
> >
> >
> > On Thu, May 6, 2010 at 7:13 PM, Bradley, Stephen W. Mr.
> >  wrote:
> >> I can't seem to get increase the number above 32768 no matter what I do.
> >>
> >> Ulimit during compile, sysctl.conf and everything else but no luck.
> >>
> >>
> >> I have about 5,000 users on a 400mbit connection.
> >>
> >> Steve
> >>
> >> RHEL5 64bit with Squid 3.1.1
> >
>
>
>
> --
> -george william herbert
> george.herb...@gmail.com
>


Re: [squid-users] Squid 2.7 without signature

2010-05-06 Thread Amos Jeffries

marcus wrote:

On Wednesday 05 May 2010 19:31:37 you wrote:

It requires patching the source; see errorpage.c, look for
'ERR_SQUID_SIGNATURE'.



I running squid in Debian Lenny system. I made my squid installation from 
debian repositories, not source files. So, I didn't found errorpage.c and 
ERR_SQUID_SIGNATURE file.




I'd support making it possible to suppress this (or turn it into an HTML
comment, as I've done) via configuration.



How?


The old way " suppress_httpd_version on" turns off display for the 
details of exact Squid release version without loosing the other 
valuable timestamp+source info in the footer/signature.




Anyway, At moment, showing my squid version for my clients isn't a big deal.

BTW, a upgrade to squid3 fix it. Doesn't it?


squid3 package in Lenny is 3.0. Which has the same behaviour as 2.7.

The squid3 package (3.1) in Unstable (and Squeeze in a week or so 
hopefully) allows configurable CSS control of the whole page.


Amos
--
Please be using
  Current Stable Squid 2.7.STABLE9 or 3.1.3


[squid-users] transparent redirect and http 302 redirects

2010-05-06 Thread Ethan Miller
Hi there -

I have a somewhat unusual project that's structured similar to the
upside-down-ternet
http://www.ex-parrot.com/pete/upside-down-ternet.html

In my case, we're looking for text patterns in html pages, then
replacing some text, saving the modified text locally (the same
machine runs squid and nginx), and then issuing the redirect for that
modified file.

This basically works - but there is some strange behavior on google
pages. Some images are broken and then clicking on a result gets you
another broken page, while a google URL remains in the address bar.

I have a simpler example that I think illustrates the issue: I use a
little custom php script for quicklinks that I can add as a search
engine in FIrefox. It just takes a string like "g yreka" and issues a
302 redirect to a google search for yreka.

Note that "yreka" is a string of interest for the squid redirector
program. This doesn't happen with other strings that the redirector
does not act upon. (That said, the redirector script isn't looking at
the text in the URL, it's grabbing the page that was requested, and
searching for the text there.)

Without using the proxy, the request/response headers look like this:

GET /?unicmd=g+yreka HTTP/1.1


HTTP/1.1 302 Found
Date: Tue, 13 Apr 2010 05:15:43 GMT
Server: Apache
X-Powered-By: PHP/5.2.11
Location: http://www.google.com/search?q=yreka


When running through the proxy, it looks like this:

GET /?unicmd=g+yreka HTTP/1.1


HTTP/1.0 200 OK
Server: nginx/0.7.62
Date: Tue, 13 Apr 2010 05:21:10 GMT
Content-Type: text/html
Content-Length: 17865
Last-Modified: Tue, 13 Apr 2010 05:21:10 GMT
Accept-Ranges: bytes
X-Cache: MISS from jefferson
X-Cache-Lookup: HIT from jefferson:3128
Via: 1.1 jefferson:3128 (squid/2.7.STABLE6)
Connection: keep-alive
Proxy-Connection: keep-alive

In my browser, I still see the ?unicmd=g+yreka URL - but the page is
the modified google results page.

Hope the question is clear, apologies for the long first message. If
you're wondering why I would be doing such a thing, the project is
described here:
http://ethanmiller.name/projects/virtual_state_jefferson/

Thanks,
- Ethan Miller