Re: [squid-users] squid with multiple NICS

[Henrik Nordstrom]

A fairly standard machine by todays measures can handle 100-200 requests
/second with only a little tuning.

Example configuration
* Decent CPU (PIII/Celeron)
* Decent amount of memory (1GB)
* 3-4 IDE drives, or SCSI SCA if you want hot-swap for service
purposes..  (cold-swap IDE bays also work for service purposes, but does
not fit in 1U)

Regards
Henrik

tis 2003-01-28 klockan 12.06 skrev HBK:
> Actaully we are Cable Operator, currently the load is 30 req/sec but it'll 
> increase, so we would liek to configure a machine which can handle around 
> 100 - 200 req/sec, 
> please comemcnt if squid can handle such large load,
> how much bandwidth can one squid box take liek currently we are deploying one 
> squid box for each 2 Mbps,
> we'll use Inet P 4 Entry Level server Board with P4 2.53 GHz Processror
> and 1 GB RAM
> 
> It would be great help if you can advise machine and squid configuration
> 
> Regards
> 
> -- Original Message ---
> From: Henrik Nordstrom <[EMAIL PROTECTED]>
> To: HBK <[EMAIL PROTECTED]>
> Sent: 27 Jan 2003 15:11:32 +0100
> Subject: Re: [squid-users] squid with multiple NICS
> 
> > CPU wise about 200-250 requests/s or ca 15-20 Mbps IIRC.
> > 
> > But to use all of that you need more drives. I would recommend to start
> > with 4 drives, 3 for cache and 1 for system+swap+logs (including
> > swap.state logs).
> > 
> > How much load do you need to handle?
> > 
> > Regards
> > Henrik
> > 
> > mån 2003-01-27 klockan 13.45 skrev HBK:
> > > Hi
> > > 
> > > I'm also using squid 2.5 stable 1 on Redhat Lilnux 8, I would like to 
> know 
> > > what the best configuration for squid machine, and how much load can 
> squid 
> > > handle
> > > 
> > > My server configuration is
> > > Intel server board SAI2 
> > > P III 1.26 GHz
> > > 1 GB RAM
> > > 1 36 GB SCSI
> > > 
> > > thanks
> > 
> > -- 
> > Henrik Nordstrom <[EMAIL PROTECTED]>
> > MARA Systems AB, Sweden
> --- End of Original Message ---
-- 
Henrik Nordstrom <[EMAIL PROTECTED]>
MARA Systems AB, Sweden

Re: [squid-users] squid with multiple NICS

[HBK]

Actaully we are Cable Operator, currently the load is 30 req/sec but it'll 
increase, so we would liek to configure a machine which can handle around 
100 - 200 req/sec, 
please comemcnt if squid can handle such large load,
how much bandwidth can one squid box take liek currently we are deploying one 
squid box for each 2 Mbps,
we'll use Inet P 4 Entry Level server Board with P4 2.53 GHz Processror
and 1 GB RAM

It would be great help if you can advise machine and squid configuration

Regards

-- Original Message ---
From: Henrik Nordstrom <[EMAIL PROTECTED]>
To: HBK <[EMAIL PROTECTED]>
Sent: 27 Jan 2003 15:11:32 +0100
Subject: Re: [squid-users] squid with multiple NICS

> CPU wise about 200-250 requests/s or ca 15-20 Mbps IIRC.
> 
> But to use all of that you need more drives. I would recommend to start
> with 4 drives, 3 for cache and 1 for system+swap+logs (including
> swap.state logs).
> 
> How much load do you need to handle?
> 
> Regards
> Henrik
> 
> mån 2003-01-27 klockan 13.45 skrev HBK:
> > Hi
> > 
> > I'm also using squid 2.5 stable 1 on Redhat Lilnux 8, I would like to 
know 
> > what the best configuration for squid machine, and how much load can 
squid 
> > handle
> > 
> > My server configuration is
> > Intel server board SAI2 
> > P III 1.26 GHz
> > 1 GB RAM
> > 1 36 GB SCSI
> > 
> > thanks
> 
> -- 
> Henrik Nordstrom <[EMAIL PROTECTED]>
> MARA Systems AB, Sweden
--- End of Original Message ---

Re: [squid-users] squid with multiple NICS

[Robert Collins]

On Tue, 2003-01-28 at 00:22, Edward D. Millington wrote:
> Minimun config as possible.
> 
> Here is my squid.conf
> 
> cache_mem 32 MB
> memory_pools off

memory pools are good. Any reason for disabling them?

Also, if you have 2X9 Gb disks, you should not have 10 cache_dir lines.
You should use one cache_dir line per physical hard disk, no more.

Are you mirroring the disks? If so I suggest mirroring /boot /usr /sbin
/var /home only, and making a /cache0 and a /cache1 physical partition
one on each disk.

If you are not mirroring the disks, give squid one entire disk as
/cache0, and any spare on the other as /cache1.

Cheers,
Rob
-- 
GPG key available at: .



signature.asc
Description: This is a digitally signed message part

Re: [squid-users] squid with multiple NICS

[Henrik Nordstrom]

CPU wise about 200-250 requests/s or ca 15-20 Mbps IIRC.

But to use all of that you need more drives. I would recommend to start
with 4 drives, 3 for cache and 1 for system+swap+logs (including
swap.state logs).

How much load do you need to handle?

Regards
Henrik


mån 2003-01-27 klockan 13.45 skrev HBK:
> Hi
> 
> I'm also using squid 2.5 stable 1 on Redhat Lilnux 8, I would like to know 
> what the best configuration for squid machine, and how much load can squid 
> handle
> 
> My server configuration is
> Intel server board SAI2 
> P III 1.26 GHz
> 1 GB RAM
> 1 36 GB SCSI
> 
> thanks

-- 
Henrik Nordstrom <[EMAIL PROTECTED]>
MARA Systems AB, Sweden

Re: [squid-users] squid with multiple NICS

[Edward D. Millington]

05| created R101 [76 / 07d3dc09.05910400:009c] on 192.168.2.17
000.05| created R101 [77 / 07d3dc09.05910400:009e] on 192.168.2.17
000.05| created R101 [78 / 07d3dc09.05910400:00a0] on 192.168.2.17
000.05| created R101 [79 / 07d3dc09.05910400:00a2] on 192.168.2.17
000.05| created R101 [80 / 07d3dc09.05910400:00a4] on 192.168.2.17
000.05| created R101 [81 / 07d3dc09.05910400:00a6] on 192.168.2.17
000.05| created R101 [82 / 07d3dc09.05910400:00a8] on 192.168.2.17
000.05| created R101 [83 / 07d3dc09.05910400:00aa] on 192.168.2.17
000.05| created R101 [84 / 07d3dc09.05910400:00ac] on 192.168.2.17
000.05| created R101 [85 / 07d3dc09.05910400:00ae] on 192.168.2.17
000.05| created R101 [86 / 07d3dc09.05910400:00b0] on 192.168.2.17
000.05| created R101 [87 / 07d3dc09.05910400:00b2] on 192.168.2.17
000.05| created R101 [88 / 07d3dc09.05910400:00b4] on 192.168.2.17
000.05| created R101 [89 / 07d3dc09.05910400:00b6] on 192.168.2.17
000.05| created R101 [90 / 07d3dc09.05910400:00b8] on 192.168.2.17
000.05| created R101 [91 / 07d3dc09.05910400:00ba] on 192.168.2.17
000.05| created R101 [92 / 07d3dc09.05910400:00bc] on 192.168.2.17
000.05| created R101 [93 / 07d3dc09.05910400:00be] on 192.168.2.17
000.05| created R101 [94 / 07d3dc09.05910400:00c0] on 192.168.2.17
000.05| created R101 [95 / 07d3dc09.05910400:00c2] on 192.168.2.17
000.05| created R101 [96 / 07d3dc09.05910400:00c4] on 192.168.2.17
000.05| created R101 [97 / 07d3dc09.05910400:00c6] on 192.168.2.17
000.05| created R101 [98 / 07d3dc09.05910400:00c8] on 192.168.2.17
000.05| created R101 [99 / 07d3dc09.05910400:00ca] on 192.168.2.17
000.05| created R101 [100 / 07d3dc09.05910400:00cc] on 192.168.2.17
000.05| created 100 agents total
000.05| fyi: current state (1) stored
000.05| fyi: working set size goal: first 1.00hour of the test
000.05| fyi: max local population size: 100 robots
000.05| fyi: server scan completed with all local robots ready to hit 
all 1 visi
ble servers
000.05| fyi: reached max local population size: 100 robots
000.13| i-dflt513 102.60953  59.26   0  100
000.22| i-dflt   1470 191.40520  88.40   0  100
000.30| i-dflt   2612 228.40440  90.37   0  100
000.40| i-dflt   3692 180.03476  88.43   0  100
000.42| Connection.cc:210: error: 1/1 (s10048) Only one usage of each 
socket add
ress (protocol/network address/port)
is normally permitted.

000.42| error writing to 192.168.2.200:80 after 0 reads, 0 writes, 1 
xacts
000.48| i-dflt   4697 201.19516  89.65   1  100
000.57| i-dflt   5661 192.80563  92.53   0  100
000.65| i-dflt   6556 179.00566  90.95   0  100
000.73| i-dflt   7640 216.80457  91.61   0  100
000.82| i-dflt   8554 182.80555  88.84   0  100
000.92| i-dflt   9435 146.84534  89.22   0  100
001.00| i-dflt  10432 199.40609  89.87   0  100
001.08| i-dflt  11208 155.20674  90.72   0  100
001.17| i-dflt  11890 136.40697  89.44   0  100
001.25| i-dflt  12798 181.60573  82.82   0  100
001.33| i-dflt  13844 209.19481  87.48   0  100
001.42| i-dflt  14843 199.80495  84.98   0  100
001.50| i-dflt  15860 203.40499  85.74   0  100

Thank you very much.

Best regards

Edward Millington
BSc, Network+, I-Net+, CIW Associate
Systems Administrator, Sr
Cariaccess Communications Ltd.
Palm Plaza
Wildey
St. Michael
Barbados

Phone:  1 246 430 7435
Mobile: 1 246 234 6278
Fax:    1 246 431 0170

[EMAIL PROTECTED]
www.cariaccess.com


-Original Message-
From: "HBK" <[EMAIL PROTECTED]>
To: "Hegedus,Ervin" <[EMAIL PROTECTED]>, Edward Millington 
<[EMAIL PROTECTED]>
Cc: [EMAIL PROTECTED]
Date: Mon, 27 Jan 2003 17:45:23 +0500
Subject: Re: [squid-users] squid with multiple NICS

> Hi
> 
> I'm also using squid 2.5 stable 1 on Redhat Lilnux 8, I would like to
> know 
> what the best configuration for squid machine, and how much load can
> squid 
> handle
> 
> My server configuration is
> Intel server board SAI2 
> P III 1.26 GHz
> 1 GB RAM
> 1 36 GB SCSI
> 
> thanks
> 
> 
> -- Original Message ---
> From: "Hegedus, Ervin" <[EMAIL PROTECTED]>
> To: Edward Millington <[EMAIL PROTECTED]>
> Sent: Sun, 26 Jan 2003 14:09:16 +0100
> Subject: Re: [squid-users] squid with multiple NICS
> 
> > Hello,
> > 
> > > Have any one ever put together squid with multiple NICS?
> > yes, i had, but i don't use currently, just one.
> > 
> > > In other words, under very stress enviroment, does it use all 2
> or more 
> nic
> > > cards at the smae time?
> > i tryed it wit 2 NICs: a client side and an Internet side.
> > But the network admins doesn't like it... :)
> > 
> > > Currently, I have been able to run my squid devel 3 over 160
> req/sec.
> > My Squid has ~800 req/sec with 1 NIC.
> > 
> > Machine is a PIII-500 proc., with 512 MB RAM, and 2x9 GB SCSI
> > disks. OS is a FreeBSD 4.7, Squid is 2.5S1
> > 
> > There is no problem...
> --- End of Original Message ---
> 

Re: [squid-users] squid with multiple NICS

[Henrik Nordstrom]

mån 2003-01-27 klockan 13.18 skrev Edward D. Millington:

> I see where 2 nics comes in, but the more load I see those devices 
> using, the more nics I see.
> 
> Alright, I am aiming to see if I can get over 200 req/sec on a stable 
> state.

For such medium low LAN load (LAN network wise speaking) a single
100Mbps NIC is way more than sufficient I would say. Adding more NICs
won't give you better performance here.

-- 
Henrik Nordstrom <[EMAIL PROTECTED]>
MARA Systems AB, Sweden

Re: [squid-users] squid with multiple NICS

[HBK]

Hi

I'm also using squid 2.5 stable 1 on Redhat Lilnux 8, I would like to know 
what the best configuration for squid machine, and how much load can squid 
handle

My server configuration is
Intel server board SAI2 
P III 1.26 GHz
1 GB RAM
1 36 GB SCSI

thanks


-- Original Message ---
From: "Hegedus, Ervin" <[EMAIL PROTECTED]>
To: Edward Millington <[EMAIL PROTECTED]>
Sent: Sun, 26 Jan 2003 14:09:16 +0100
Subject: Re: [squid-users] squid with multiple NICS

> Hello,
> 
> > Have any one ever put together squid with multiple NICS?
> yes, i had, but i don't use currently, just one.
> 
> > In other words, under very stress enviroment, does it use all 2 or more 
nic
> > cards at the smae time?
> i tryed it wit 2 NICs: a client side and an Internet side.
> But the network admins doesn't like it... :)
> 
> > Currently, I have been able to run my squid devel 3 over 160 req/sec.
> My Squid has ~800 req/sec with 1 NIC.
> 
> Machine is a PIII-500 proc., with 512 MB RAM, and 2x9 GB SCSI
> disks. OS is a FreeBSD 4.7, Squid is 2.5S1
> 
> There is no problem...
--- End of Original Message ---

Re: [squid-users] squid with multiple NICS

[Edward D. Millington]

Ok. I am using wccp.

I see where 2 nics comes in, but the more load I see those devices 
using, the more nics I see.

Alright, I am aiming to see if I can get over 200 req/sec on a stable 
state.

Thank you very much.

Best regards

Edward Millington
BSc, Network+, I-Net+, CIW Associate
Systems Administrator, Sr
Cariaccess Communications Ltd.
Palm Plaza
Wildey
St. Michael
Barbados

Phone:  1 246 430 7435
Mobile: 1 246 234 6278
Fax:    1 246 431 0170

[EMAIL PROTECTED]
www.cariaccess.com


-Original Message-
From: Henrik Nordstrom <[EMAIL PROTECTED]>
To: "Edward Millington" <[EMAIL PROTECTED]>, 
Date: Mon, 27 Jan 2003 01:29:56 +0100
Subject: Re: [squid-users] squid with multiple NICS

> Yes, most of our products have more than one NIC for firewalling 
> purposes.
> 
> Squid does not really care how many NICs your box have. It is the 
> responsibility of the OS to configure NIC addresses and routing, 
> Squid just makes use of what you have.
> 
> To aid the OS in this use Squid can specify which addresses it want
> to 
> use. See the squid.conf directives http_port and 
> tcp_outgoing_address.
> 
> 
> There is no need for interface bonding for such low network workloads
> as Squid. A single 100Mbps NIC is more than sufficient for almost any
> Squid in terms of performance. However, if you set up interface 
> bonding in your OS for higher bandwidth connectivity to your switch 
> or router then Squid will happily use such bonded interfaces, just as
> any other application on your box would.
> 
> Regards
> Henrik Nordström
> MARA Systems AB, Sweden
> 
> 
> 
> On Sunday 26 January 2003 13.32, Edward Millington wrote:
> > Hi Everyone!
> >
> > Have any one ever put together squid with multiple NICS?
> >
> > If you purchase a commercial cache, sometimes you can get 2 or more
> > nics?
> >
> > My question is, are those nics load sharing or are there bonded as
> > one nic card?
> >
> > In other words, under very stress enviroment, does it use all 2 or
> > more nic cards at the smae time?
> >
> > Currently, I have been able to run my squid devel 3 over 160
> > req/sec.
> >
> > Over that, my testing machine is the problem with dishing out alot
> > of requests. My test machine is a win2k 950MHz..

Re: [squid-users] squid with multiple NICS

[Hegedus, Ervin]

Hello,

> > My Squid has ~800 req/sec with 1 NIC.
> 
> are you sure about your claim?
Oh, i'm sorry, i overlooked that in my cachemgr...:(

Average HTTP requests per minute since start:752.2

it is ~800 req/MINUTE, not second... :(


I'm really sorry again...



air

Re: [squid-users] squid with multiple NICS

[fooler]

- Original Message - 
From: "Hegedus, Ervin" <[EMAIL PROTECTED]>
To: "Edward Millington" <[EMAIL PROTECTED]>
Cc: <[EMAIL PROTECTED]>
Sent: Sunday, January 26, 2003 9:09 PM
Subject: Re: [squid-users] squid with multiple NICS


> My Squid has ~800 req/sec with 1 NIC.

are you sure about your claim?

fooler.

Re: [squid-users] squid with multiple NICS

[Henrik Nordstrom]

Yes, most of our products have more than one NIC for firewalling 
purposes.

Squid does not really care how many NICs your box have. It is the 
responsibility of the OS to configure NIC addresses and routing, 
Squid just makes use of what you have.

To aid the OS in this use Squid can specify which addresses it want to 
use. See the squid.conf directives http_port and 
tcp_outgoing_address.


There is no need for interface bonding for such low network workloads 
as Squid. A single 100Mbps NIC is more than sufficient for almost any 
Squid in terms of performance. However, if you set up interface 
bonding in your OS for higher bandwidth connectivity to your switch 
or router then Squid will happily use such bonded interfaces, just as 
any other application on your box would.

Regards
Henrik Nordström
MARA Systems AB, Sweden



On Sunday 26 January 2003 13.32, Edward Millington wrote:
> Hi Everyone!
>
> Have any one ever put together squid with multiple NICS?
>
> If you purchase a commercial cache, sometimes you can get 2 or more
> nics?
>
> My question is, are those nics load sharing or are there bonded as
> one nic card?
>
> In other words, under very stress enviroment, does it use all 2 or
> more nic cards at the smae time?
>
> Currently, I have been able to run my squid devel 3 over 160
> req/sec.
>
> Over that, my testing machine is the problem with dishing out alot
> of requests. My test machine is a win2k 950MHz..

Re: [squid-users] squid with multiple NICS

[Edward Millington]

That 800 figure doesn't sound right. either way, that is good.
- Original Message -
From: "Hegedus, Ervin" <[EMAIL PROTECTED]>
To: "Edward Millington" <[EMAIL PROTECTED]>
Cc: <[EMAIL PROTECTED]>
Sent: Sunday, January 26, 2003 9:09 AM
Subject: Re: [squid-users] squid with multiple NICS


> Hello,
>
> > Have any one ever put together squid with multiple NICS?
> yes, i had, but i don't use currently, just one.
>
>
> > In other words, under very stress enviroment, does it use all 2 or more
nic
> > cards at the smae time?
> i tryed it wit 2 NICs: a client side and an Internet side.
> But the network admins doesn't like it... :)
>
> > Currently, I have been able to run my squid devel 3 over 160 req/sec.
> My Squid has ~800 req/sec with 1 NIC.
>
> Machine is a PIII-500 proc., with 512 MB RAM, and 2x9 GB SCSI
> disks. OS is a FreeBSD 4.7, Squid is 2.5S1
>
> There is no problem...
>

Re: [squid-users] squid with multiple NICS

[Matteo Tescione]

Hello,
try to equalize the default route.
somethin like: ip route add default gw IP dev eth0 equalize dev eth1
I'm not on linux right now and I can't check the command, but this is almost
true...
King regards,

Matteo Tescione
RMnet Communications

- Original Message -
From: "Edward Millington" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Sunday, January 26, 2003 1:32 PM
Subject: [squid-users] squid with multiple NICS


> Hi Everyone!
>
> Have any one ever put together squid with multiple NICS?
>
> If you purchase a commercial cache, sometimes you can get 2 or more nics?
>
> My question is, are those nics load sharing or are there bonded as one nic
> card?
>
> In other words, under very stress enviroment, does it use all 2 or more
nic
> cards at the smae time?
>
> Currently, I have been able to run my squid devel 3 over 160 req/sec.
>
> Over that, my testing machine is the problem with dishing out alot of
> requests. My test machine is a win2k 950MHz..
>

Re: [squid-users] squid with multiple NICS

[Hegedus, Ervin]

Hello,

> Have any one ever put together squid with multiple NICS?
yes, i had, but i don't use currently, just one.


> In other words, under very stress enviroment, does it use all 2 or more nic
> cards at the smae time?
i tryed it wit 2 NICs: a client side and an Internet side.
But the network admins doesn't like it... :)

> Currently, I have been able to run my squid devel 3 over 160 req/sec.
My Squid has ~800 req/sec with 1 NIC.

Machine is a PIII-500 proc., with 512 MB RAM, and 2x9 GB SCSI
disks. OS is a FreeBSD 4.7, Squid is 2.5S1

There is no problem...