On Wed, Jun 23, 1999 at 08:16:40PM -0400, jamal wrote:
>
>
> > Do you want the output of the above mentioned 'tc' commands now (while
> > it is working) or after an hour or so (when it stops)?
>
> Can you post your script, output etc and point out exactly which interface
> it happens on?
>
Here are two attachments with tc output -- the first soon after starting
up, and the second after the interface died (as requested). I hope this
helps. This was produced using iproute 990530 and kernel 2.2.10.
For now, I have a simple crontab perl script I wrote that checks a host
on each interface, and if nobody answers, it shuts down and restarts tc
on all interfaces and pages me -- I've gotten several pages already, but
at least it seems to be keeping the interfaces up and running.
Other than this one problem, I am very pleased with cbq under Linux.
It is saving my ISP a lot of money and helping our co-located servers
behave themselves. I have already been able to retire a Cisco 2514. :)
I am using cbq.init to set up the traffic shaping (a very slick script
I found at ftp://ftp.equinox.gu.net/pub/linux/cbq/ ).
|-eth1--a hub with a bunch of colocated servers
backbone--eth0--linux
|_eth2--a microwave shot across the street, 1/2 of a class C
(IPs changed to protect the guilty.)
---
# Co-locate servers with a 128k connection to backbone
#
DEVICE=eth0,100Mbit,10Mbit #device,real bandwidth, weight (~bandwidth/10)
RATE=128Kbit #Shaper speed
WEIGHT=12Kbit #(~RATE/10)
PRIO=5 #Shaper priority
LIMIT=256Kbit # burst
RULE=10.0.0.11, #[source addr][:source port],[dest addr][:dest port]
# ^-- this is a source address!
---
# Co-locate servers with a 128k connection to eth2
# This is the device that chokes after an unpredictable amount of time
#
DEVICE=eth2,100Mbit,10Mbit
RATE=128Kbit
WEIGHT=12Kbit
PRIO=5
LIMIT=256Kbit
RULE=10.0.0.11
---
# subnet 1/2 of a class C -- connection to the backbone
#
DEVICE=eth0,100Mbit,10Mbit
RATE=256Kbit
WEIGHT=24Kbit
PRIO=5
LIMIT=320Kbit
RULE=10.0.5.0/28,
# ^-- this is a source address!
---
# subnet 1/2 of a class C -- microwave shot on eth1
#
DEVICE=eth1,100Mbit,10Mbit
RATE=256Kbit
WEIGHT=24Kbit
PRIO=5
LIMIT=320Kbit
RULE=10.0.5.0/28
---
-Erik
--
Erik B. Andersen Web: http://www.xmission.com/~andersen/
email: [EMAIL PROTECTED]
--This message was written using 73% post-consumer electrons--
---------------------------------------------------------------------
--LZvS9be/3tNcYl/X
Content-Type: text/plain; charset=us-ascii
Content-Disposition: attachment; filename=cbq_report_at_start
Script started on Wed Jun 23 19:20:22 1999
r2d2:~# tc -s -d qdisc ls dev eth0
qdisc tbf 8037: rate 256Kbit burst 10Kb/8 mpu 0b lat 839.2ms
Sent 78 bytes 1 pkts (dropped 0, overlimits 0)
qdisc tbf 8035: rate 128Kbit burst 10Kb/8 mpu 0b lat 1.7s
Sent 29581 bytes 55 pkts (dropped 0, overlimits 0)
qdisc cbq 10: rate 100Mbit cell 8b (bounded,isolated) prio no-transmit/8 weight
100Mbit allot 1514b
level 2 ewma 5 avpkt 1000b maxidle 1us
Sent 420003 bytes 1322 pkts (dropped 0, overlimits 360)
borrowed 0 overactions 0 avgidle 62 undertime 0
r2d2:~# tc -s -d qdisc ls dev eth1
qdisc tbf 8038: rate 256Kbit burst 10Kb/8 mpu 0b lat 839.2ms
Sent 140 bytes 1 pkts (dropped 0, overlimits 0)
qdisc cbq 11: rate 100Mbit cell 8b (bounded,isolated) prio no-transmit/8 weight
100Mbit allot 1514b
level 2 ewma 5 avpkt 1000b maxidle 1us
Sent 390975 bytes 846 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle 62 undertime 0
r2d2:~# tc -s -d qdisc ls dev eth2
qdisc tbf 8036: rate 128Kbit burst 10Kb/8 mpu 0b lat 1.7s
Sent 8814 bytes 57 pkts (dropped 0, overlimits 0)
qdisc cbq 12: rate 100Mbit cell 8b (bounded,isolated) prio no-transmit/8 weight
100Mbit allot 1514b
level 2 ewma 5 avpkt 1000b maxidle 1us
Sent 8898 bytes 59 pkts (dropped 0, overlimits 165)
borrowed 0 overactions 0 avgidle -9.44938e+06 undertime 0
r2d2:~# tc -s -d class ls dev eth0
class cbq 10:2561 parent 10:1 leaf 8037: rate 256Kbit cell 8b (bounded) prio 5/5
weight 24Kbit allot 1514b
level 0 ewma 5 avpkt 1000b maxidle 26999us
Sent 78 bytes 1 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle -3.63737e+08 undertime 2.91219e+08
class cbq 10: root rate 100Mbit cell 8b (bounded,isolated) prio no-transmit/8 weight
100Mbit allot 1514b
level 2 ewma 5 avpkt 1000b maxidle 1us
Sent 433681 bytes 1444 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle 62 undertime 0
class cbq 10:1 parent 10: rate 100Mbit cell 8b prio no-transmit/8 weight 10Mbit allot
1514b
level 1 ewma 5 avpkt 1000b maxidle 1us
Sent 29659 bytes 56 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle -3.47588e+07 undertime -2.74807e+07
class cbq 10:1281 parent 10:1 leaf 8035: rate 128Kbit cell 8b (bounded) prio 5/5
weight 12Kbit allot 1514b
level 0 ewma 5 avpkt 1000b maxidle 54068us
Sent 29581 bytes 55 pkts (dropped 0, overlimits 494)
borrowed 0 overactions 54 avgidle -6.97047e+07 undertime -2.5847e+07
r2d2:~# tc -s -d class ls dev eth1
class cbq 11: root rate 100Mbit cell 8b (bounded,isolated) prio no-transmit/8 weight
100Mbit allot 1514b
level 2 ewma 5 avpkt 1000b maxidle 1us
Sent 496496 bytes 960 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle 62 undertime 0
class cbq 11:1 parent 11: rate 100Mbit cell 8b prio no-transmit/8 weight 10Mbit allot
1514b
level 1 ewma 5 avpkt 1000b maxidle 1us
Sent 140 bytes 1 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle -3.6438e+08 undertime 2.903e+08
class cbq 11:2562 parent 11:1 leaf 8038: rate 256Kbit cell 8b (bounded) prio 5/5
weight 24Kbit allot 1514b
level 0 ewma 5 avpkt 1000b maxidle 26999us
Sent 140 bytes 1 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle -3.63698e+08 undertime 2.89642e+08
r2d2:~# tc -s -d class ls dev eth2
class cbq 12: root rate 100Mbit cell 8b (bounded,isolated) prio no-transmit/8 weight
100Mbit allot 1514b
level 2 ewma 5 avpkt 1000b maxidle 1us
Sent 8898 bytes 59 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle -9.44938e+06 undertime 0
class cbq 12:1 parent 12: rate 100Mbit cell 8b prio no-transmit/8 weight 10Mbit allot
1514b
level 1 ewma 5 avpkt 1000b maxidle 1us
Sent 8814 bytes 57 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle -1.61387e+07 undertime 1.16367e+07
class cbq 12:1282 parent 12:1 leaf 8036: rate 128Kbit cell 8b (bounded) prio 5/5
weight 12Kbit allot 1514b
level 0 ewma 5 avpkt 1000b maxidle 54068us
Sent 8814 bytes 57 pkts (dropped 0, overlimits 175)
borrowed 0 overactions 56 avgidle -1.60828e+07 undertime 1.15849e+07
r2d2:~#
Script done on Wed Jun 23 19:21:31 1999
---------------------------------------------------------------------
--LZvS9be/3tNcYl/X
Content-Type: text/plain; charset=us-ascii
Content-Disposition: attachment; filename=cbq_report_failure
Script started on Thu Jun 24 03:21:25 1999
r2d2:~# tc -s -d qdisc ls dev eth0
qdisc tbf 803f: rate 256Kbit burst 10Kb/8 mpu 0b lat 1.1s
Sent 0 bytes 0 pkts (dropped 0, overlimits 0)
qdisc tbf 803d: rate 128Kbit burst 10Kb/8 mpu 0b lat 1.7s
Sent 196841 bytes 517 pkts (dropped 131, overlimits 29)
backlog 32735b 68p
qdisc cbq 10: rate 100Mbit cell 8b (bounded,isolated) prio no-transmit/8 weight
100Mbit allot 1514b
level 2 ewma 5 avpkt 1000b maxidle 1us
Sent 1925635 bytes 5640 pkts (dropped 131, overlimits 50902)
backlog 68p
borrowed 0 overactions 0 avgidle 31 undertime 0
r2d2:~# tc -s -d qdisc ls dev eth1
qdisc tbf 8040: rate 256Kbit burst 10Kb/8 mpu 0b lat 1.1s
Sent 0 bytes 0 pkts (dropped 0, overlimits 0)
qdisc cbq 11: rate 100Mbit cell 8b (bounded,isolated) prio no-transmit/8 weight
100Mbit allot 1514b
level 2 ewma 5 avpkt 1000b maxidle 1us
Sent 1398174 bytes 5691 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle 31 undertime 0
r2d2:~# tc -s -d qdisc ls dev eth2
qdisc tbf 803e: rate 128Kbit burst 10Kb/8 mpu 0b lat 1.7s
Sent 92578 bytes 817 pkts (dropped 0, overlimits 0)
backlog 21041b 294p
qdisc cbq 12: rate 100Mbit cell 8b (bounded,isolated) prio no-transmit/8 weight
100Mbit allot 1514b
level 2 ewma 5 avpkt 1000b maxidle 1us
Sent 99634 bytes 985 pkts (dropped 0, overlimits 141312)
backlog 294p
borrowed 0 overactions 0 avgidle 31 undertime 0
r2d2:~# tc -s -d class ls dev eth0
class cbq 10:2561 parent 10:1 leaf 803f: rate 256Kbit cell 8b (bounded) prio 5/5
weight 24Kbit allot 1514b
level 0 ewma 5 avpkt 1000b maxidle 26999us
Sent 0 bytes 0 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle 707804 undertime 0
class cbq 10: root rate 100Mbit cell 8b (bounded,isolated) prio no-transmit/8 weight
100Mbit allot 1514b
level 2 ewma 5 avpkt 1000b maxidle 1us
Sent 1897451 bytes 5605 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle 31 undertime 0
class cbq 10:1 parent 10: rate 100Mbit cell 8b prio no-transmit/8 weight 10Mbit allot
1514b
level 1 ewma 5 avpkt 1000b maxidle 1us
Sent 164106 bytes 449 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle 62 undertime 0
class cbq 10:1281 parent 10:1 leaf 803d: rate 128Kbit cell 8b (bounded) prio 5/5
weight 12Kbit allot 1514b
level 0 ewma 5 avpkt 1000b maxidle 54068us
Sent 164106 bytes 449 pkts (dropped 131, overlimits 57488)
backlog 68p
borrowed 0 overactions 2 avgidle -67566 undertime 58761
r2d2:~# tc -s -d class ls dev eth1
class cbq 11: root rate 100Mbit cell 8b (bounded,isolated) prio no-transmit/8 weight
100Mbit allot 1514b
level 2 ewma 5 avpkt 1000b maxidle 1us
Sent 1398401 bytes 5695 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle 31 undertime 0
class cbq 11:1 parent 11: rate 100Mbit cell 8b prio no-transmit/8 weight 10Mbit allot
1514b
level 1 ewma 5 avpkt 1000b maxidle 1us
Sent 0 bytes 0 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle 62 undertime 0
class cbq 11:2562 parent 11:1 leaf 8040: rate 256Kbit cell 8b (bounded) prio 5/5
weight 24Kbit allot 1514b
level 0 ewma 5 avpkt 1000b maxidle 26999us
Sent 0 bytes 0 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle 707804 undertime 0
r2d2:~# tc -s -d class ls dev eth2
class cbq 12: root rate 100Mbit cell 8b (bounded,isolated) prio no-transmit/8 weight
100Mbit allot 1514b
level 2 ewma 5 avpkt 1000b maxidle 1us
Sent 79013 bytes 701 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle 31 undertime 0
class cbq 12:1 parent 12: rate 100Mbit cell 8b prio no-transmit/8 weight 10Mbit allot
1514b
level 1 ewma 5 avpkt 1000b maxidle 1us
Sent 71537 bytes 523 pkts (dropped 0, overlimits 0)
borrowed 0 overactions 0 avgidle 34 undertime 0
class cbq 12:1282 parent 12:1 leaf 803e: rate 128Kbit cell 8b (bounded) prio 5/5
weight 12Kbit allot 1514b
level 0 ewma 5 avpkt 1000b maxidle 54068us
Sent 71537 bytes 523 pkts (dropped 0, overlimits 142680)
backlog 294p
borrowed 0 overactions 1 avgidle -782 undertime 2169
r2d2:~# ping ns2.< a bandwidth-controled class C network on eth1>
<pings work just fine>
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max = 11.8/12.9/14.1 ms
r2d2:~# ping <a bandwidth-controlled IP on eth2>
<nothing>
2 packets transmitted, 0 packets received, 100% packet loss
r2d2:~# ping <a different bandwidth-controlled IP on eth2>
<nothing>
4 packets transmitted, 0 packets received, 100% packet loss
r2d2:~# /etc/init.d/cbq stop ; /etc/init.d/cbq start
<all is now well, and I can ping any host on eth2 now>
Script done on Thu Jun 24 03:22:19 1999
--LZvS9be/3tNcYl/X--
-
To unsubscribe from this list: send the line "unsubscribe linux-net" in
the body of a message to [EMAIL PROTECTED]
