Re: [squid-users] Multi ISP Load Balancing Problem

2008-02-28 Thread Amos Jeffries

Lazuardi Nasution wrote:

Hi all,

I'm running Windows based multi instance Squid with multi interface
connected to different ISP for load balancing. The configuration is like
below.

Squid Main
http_port :8080
icp_port 3130
tcp_outgoing_adderss 

Squid Parent A
http_port :8081
icp_port 3131
tcp_outgoing_adderss 

Squid Parent B
http_port :8082
icp_port 3132
tcp_outgoing_adderss 

Users -> Main Squid -(Round Robbin Parent)-> Squid Parent A/B -(Direct)->
ISP A/B -> Internet

The performance is very bad and sometime Squid Parent B was hang (service
was stopped) with "Loop" related log on Cache.Log. I didn't see CPU and
RAM exhausting and the HD queue was low enough.

Any suggestion with my problem ?


Any info as to what squid version and release you are using?
And what the error actually says?

Amos
--
Please use Squid 2.6STABLE17+ or 3.0STABLE1+
There are serious security advisories out on all earlier releases.


RE: [squid-users] Multi ISP Load Balancing Problem

2008-02-28 Thread Lazuardi Nasution
We are using Squid 2.6STABLE18 for Windows. The performance is so bad. Here
is some of weird things on log file, I don't have any idea of them.

2008/02/28 11:17:38| comm_select: select failure: (10038) WSAENOTSOCK,
Socket operation on nonsocket.
2008/02/28 11:17:38| Select loop Error. Retry 10
FATAL: Select Loop failed!
Squid Cache (Version 2.6.STABLE18): Terminated abnormally.
CPU Usage: 106.922 seconds = 35.922 user + 71.000 sys
Maximum Resident Size: 41444 KB
Page faults with physical i/o: 12269

These errors only happen when there is many users are accessing the Squid.
These errors didb't happen when I just using one instance and do load
balancing by separating tcp_outgoing_address on Squid Main based on odd or
even clients source address, I'm not satisfied with this load balancing
method.

Best regards,


-Original Message-
From: Amos Jeffries [mailto:[EMAIL PROTECTED] 
Sent: Thursday, February 28, 2008 8:58 PM
To: Lazuardi Nasution
Cc: squid-users@squid-cache.org
Subject: Re: [squid-users] Multi ISP Load Balancing Problem

Lazuardi Nasution wrote:
> Hi all,
> 
> I'm running Windows based multi instance Squid with multi interface 
> connected to different ISP for load balancing. The configuration is 
> like below.
> 
> Squid Main
> http_port :8080
> icp_port 3130
> tcp_outgoing_adderss 
> 
> Squid Parent A
> http_port :8081
> icp_port 3131
> tcp_outgoing_adderss 
> 
> Squid Parent B
> http_port :8082
> icp_port 3132
> tcp_outgoing_adderss 
> 
> Users -> Main Squid -(Round Robbin Parent)-> Squid Parent A/B 
> -(Direct)-> ISP A/B -> Internet
> 
> The performance is very bad and sometime Squid Parent B was hang 
> (service was stopped) with "Loop" related log on Cache.Log. I didn't 
> see CPU and RAM exhausting and the HD queue was low enough.
> 
> Any suggestion with my problem ?

Any info as to what squid version and release you are using?
And what the error actually says?

Amos
--
Please use Squid 2.6STABLE17+ or 3.0STABLE1+ There are serious security
advisories out on all earlier releases.



Re: [squid-users] Multi ISP Load Balancing Problem

2008-02-28 Thread Adrian Chadd

.. how hard are you pushing squid under Windows?



Adrian

On Fri, Feb 29, 2008, Lazuardi Nasution wrote:
> We are using Squid 2.6STABLE18 for Windows. The performance is so bad. Here
> is some of weird things on log file, I don't have any idea of them.
> 
> 2008/02/28 11:17:38| comm_select: select failure: (10038) WSAENOTSOCK,
> Socket operation on nonsocket.
> 2008/02/28 11:17:38| Select loop Error. Retry 10
> FATAL: Select Loop failed!
> Squid Cache (Version 2.6.STABLE18): Terminated abnormally.
> CPU Usage: 106.922 seconds = 35.922 user + 71.000 sys
> Maximum Resident Size: 41444 KB
> Page faults with physical i/o: 12269
> 
> These errors only happen when there is many users are accessing the Squid.
> These errors didb't happen when I just using one instance and do load
> balancing by separating tcp_outgoing_address on Squid Main based on odd or
> even clients source address, I'm not satisfied with this load balancing
> method.
> 
> Best regards,
> 
> 
> -Original Message-
> From: Amos Jeffries [mailto:[EMAIL PROTECTED] 
> Sent: Thursday, February 28, 2008 8:58 PM
> To: Lazuardi Nasution
> Cc: squid-users@squid-cache.org
> Subject: Re: [squid-users] Multi ISP Load Balancing Problem
> 
> Lazuardi Nasution wrote:
> > Hi all,
> > 
> > I'm running Windows based multi instance Squid with multi interface 
> > connected to different ISP for load balancing. The configuration is 
> > like below.
> > 
> > Squid Main
> > http_port :8080
> > icp_port 3130
> > tcp_outgoing_adderss 
> > 
> > Squid Parent A
> > http_port :8081
> > icp_port 3131
> > tcp_outgoing_adderss 
> > 
> > Squid Parent B
> > http_port :8082
> > icp_port 3132
> > tcp_outgoing_adderss 
> > 
> > Users -> Main Squid -(Round Robbin Parent)-> Squid Parent A/B 
> > -(Direct)-> ISP A/B -> Internet
> > 
> > The performance is very bad and sometime Squid Parent B was hang 
> > (service was stopped) with "Loop" related log on Cache.Log. I didn't 
> > see CPU and RAM exhausting and the HD queue was low enough.
> > 
> > Any suggestion with my problem ?
> 
> Any info as to what squid version and release you are using?
> And what the error actually says?
> 
> Amos
> --
> Please use Squid 2.6STABLE17+ or 3.0STABLE1+ There are serious security
> advisories out on all earlier releases.

-- 
- Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
- $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -


RE: [squid-users] Multi ISP Load Balancing Problem

2008-03-04 Thread Lazuardi Nasution
Hi,

I'm using Windows 2000 with Service Pack 4. If you think that it is a file
descriptor problem, why this problem apear when I install 3 Squid Services
but not happen on previous configuration which install one Squid Service
only ? I don't understand about select(). The Loop related error has been
solved by not using ICP between Main to both Parent and Parent to Parent
sibling relation ship. But the performance with 3 Squid Services still bad.

Best regards,

-Original Message-
From: Guido Serassio [mailto:[EMAIL PROTECTED] 
Sent: Monday, March 03, 2008 12:37 AM
To: Lazuardi Nasution; squid-users@squid-cache.org
Subject: RE: [squid-users] Multi ISP Load Balancing Problem

Hi,

At 19:51 28/02/2008, Lazuardi Nasution wrote:
>We are using Squid 2.6STABLE18 for Windows. The performance is so bad. 
>Here is some of weird things on log file, I don't have any idea of them.

Exactly what Windows version ? I hope that you are using a Windows Server
2003 machine 

>2008/02/28 11:17:38| comm_select: select failure: (10038) WSAENOTSOCK, 
>Socket operation on nonsocket.
>2008/02/28 11:17:38| Select loop Error. Retry 10
>FATAL: Select Loop failed!
>Squid Cache (Version 2.6.STABLE18): Terminated abnormally.
>CPU Usage: 106.922 seconds = 35.922 user + 71.000 sys Maximum Resident 
>Size: 41444 KB Page faults with physical i/o: 12269
>
>These errors only happen when there is many users are accessing the Squid.
>These errors didb't happen when I just using one instance and do load 
>balancing by separating tcp_outgoing_address on Squid Main based on odd 
>or even clients source address, I'm not satisfied with this load 
>balancing method.

Don't forget that scalability of Squid on Windows is very limited:
- Maximum file descriptors number is hard coded to 2048 in the Microsoft C
Runtime library, so you can safely support a top of around 660 CONCURRENT
object requests without user authentication. 
Please note: OBJECT requests, not concurrent USERS.
- For portability reasons, the comm loop is based on select(), this is not
the better thing for speed.

Here you can find some tips on tuning TCP on Windows:
http://smallvoid.com/article/winnt-tcpip-max-limit.html

Regards

Guido



-

Guido Serassio
Acme Consulting S.r.l. - Microsoft Certified Partner
Via Lucia Savarino, 1   10098 - Rivoli (TO) - ITALY
Tel. : +39.011.9530135  Fax. : +39.011.9781115
Email: [EMAIL PROTECTED]
WWW: http://www.acmeconsulting.it/



RE: [squid-users] Multi ISP Load Balancing Problem

2008-03-05 Thread Guido Serassio

HI,

At 19:58 04/03/2008, Lazuardi Nasution wrote:

Hi,

I'm using Windows 2000 with Service Pack 4.


Server, right ?


 If you think that it is a file
descriptor problem, why this problem apear when I install 3 Squid Services
but not happen on previous configuration which install one Squid Service
only ? I don't understand about select(). The Loop related error has been
solved by not using ICP between Main to both Parent and Parent to Parent
sibling relation ship.


I think that you are pushing too much squid under Windows.


But the performance with 3 Squid Services still bad.


select() is the worst Squid comm loops.

For a really high performance cache, you should use another OS.
Please note that I'm writing this as the maintainer of the Windows 
port of Squid  :-)


Regards

Guido



-

Guido Serassio
Acme Consulting S.r.l. - Microsoft Certified Partner
Via Lucia Savarino, 1   10098 - Rivoli (TO) - ITALY
Tel. : +39.011.9530135  Fax. : +39.011.9781115
Email: [EMAIL PROTECTED]
WWW: http://www.acmeconsulting.it/



RE: [squid-users] Multi ISP Load Balancing Problem

2008-03-06 Thread Lazuardi Nasution
Hi,

I'm using Windows 2000 Server. I don't know if I have pushed my server very
hard because there is no warning event on server resource monitoring system.
I have done with this trouble and have almost sophisticated result by doing
following configuration.

* give diffrent IP and port for each Squid instance by http_port
* give diffrent port for each Squid instance by icp_port
* give diffrent IP for each Squid instance by tcp_outgoing_address (for
handling different ISP)
* give diffrent IP for each Squid instance by udp_incoming_address

Main Squid -(Parent)-> Parent Squid A -(Direct)-> ISP A
Main Squid -(Parent)-> Parent Squid B -(Direct)-> ISP B
Parent Squid A <-(Sibling)-> Parent Squid B

Best regards,

-Original Message-
From: Guido Serassio [mailto:[EMAIL PROTECTED] 
Sent: Thursday, March 06, 2008 5:22 AM
To: Lazuardi Nasution; squid-users@squid-cache.org
Subject: RE: [squid-users] Multi ISP Load Balancing Problem

HI,

At 19:58 04/03/2008, Lazuardi Nasution wrote:
>Hi,
>
>I'm using Windows 2000 with Service Pack 4.

Server, right ?

>  If you think that it is a file
>descriptor problem, why this problem apear when I install 3 Squid 
>Services but not happen on previous configuration which install one 
>Squid Service only ? I don't understand about select(). The Loop 
>related error has been solved by not using ICP between Main to both 
>Parent and Parent to Parent sibling relation ship.

I think that you are pushing too much squid under Windows.

>But the performance with 3 Squid Services still bad.

select() is the worst Squid comm loops.

For a really high performance cache, you should use another OS.
Please note that I'm writing this as the maintainer of the Windows port of
Squid  :-)

Regards

Guido



-

Guido Serassio
Acme Consulting S.r.l. - Microsoft Certified Partner
Via Lucia Savarino, 1   10098 - Rivoli (TO) - ITALY
Tel. : +39.011.9530135  Fax. : +39.011.9781115
Email: [EMAIL PROTECTED]
WWW: http://www.acmeconsulting.it/