Re: Bandwidth issues in the Sprint network
Some people wanted to know what I found the problem to be. I have discovered. the problem for a fact is the TCP window size on uploads. I have a Linux box that I changed the Window sizes to match and I still get 32k on a upload window and 64k on a download window. With a ping time of 50ms I have a max theoretical throughput of 5.2Mbps Which is about what I was getting. The formula to calculate this is the following. (((Ts/Tw)*Rtd)/1000)+((Ts*8)/(Lr*1000))) Where the following are Ts = Transfer size in Bytes Tw = Tcp Window size in Bytes Rtd = Round trip Delay in milliseconds Lr = Line rate in bps At this point I am still trying to locate the offending device that is changing the window size. After I determine for sure whether the problem is with my router, the sprint network, or another upstream system I will let everybody know what I find. -- Brian Raaen Network Engineer [EMAIL PROTECTED] On Monday 07 April 2008, Brian Raaen wrote: I am currently having problems get upload bandwidth on a Sprint circuit. I am using a full OC3 circuit. I am doing fine on downloading data, but uploading data I can only get about 5Mbps with ftp or a speedtest. I have tested against multiple networks and this has stayed the same. Monitoring Cacti graphs and the router I do get about 30Mbps total traffic outbound, but individual (flows/ip?) test always seem limited. I would like to know if anyone else sees anything similar, or where I can get help. The assistance I have gotten from Sprint up to this point is that they find no problems. Due to the consistency of 5Mbps I am suspecting rate limiting, but wanted to know if I was overlooking something else. -- Brian Raaen Network Engineer [EMAIL PROTECTED] signature.asc Description: This is a digitally signed message part.
Re: Bandwidth issues in the Sprint network
Currently there is not a proxy server in the network, although when using some of the test on dslreports.com there is a message about compression being used for the upload and to remove proxy settings. I have also been testing using FTP on a *nix server as well. Both the server and PC are connect to a Cisco 2960 switch in the headend that is connected to the 7200 router. I can transfer ftp at about 80Mbps between the PC and the server, so they are not IO bound. The Site I am testing with is a ftp server located in a colo facility that we use and has sufficient bandwidth. This circuit is clean in the sense of not having CRC, framing or other errors but this is a new circuit and we have never gotten more than 5Mbps out of a single session (flow/ip) across the wan. I would have to double check the mtu, but it is currently the default. -- Brian Raaen Network Engineer [EMAIL PROTECTED] On Monday 07 April 2008, Brian Raaen wrote: I am currently having problems get upload bandwidth on a Sprint circuit. I am using a full OC3 circuit. I am doing fine on downloading data, but uploading data I can only get about 5Mbps with ftp or a speedtest. I have tested against multiple networks and this has stayed the same. Monitoring Cacti graphs and the router I do get about 30Mbps total traffic outbound, but individual (flows/ip?) test always seem limited. I would like to know if anyone else sees anything similar, or where I can get help. The assistance I have gotten from Sprint up to this point is that they find no problems. Due to the consistency of 5Mbps I am suspecting rate limiting, but wanted to know if I was overlooking something else. -- Brian Raaen Network Engineer [EMAIL PROTECTED] signature.asc Description: This is a digitally signed message part.
Re: Bandwidth issues in the Sprint network
I have been using the Java based versions of the speed test. At this point I have had some Sprint people get in contact with me so I will see what they find. Thank you for all your help to everyone. -- Brian Raaen Network Engineer [EMAIL PROTECTED] On Monday 07 April 2008, you wrote: I am currently having problems get upload bandwidth on a Sprint circuit. I am using a full OC3 circuit. I am doing fine on downloading data, but uploading data I can only get about 5Mbps with ftp or a speedtest. I have tested against multiple networks and this has stayed the same. Monitoring Cacti graphs and the router I do get about 30Mbps total traffic outbound, but individual (flows/ip?) test always seem limited. I would like to know if anyone else sees anything similar, or where I can get help. The assistance I have gotten from Sprint up to this point is that they find no problems. Due to the consistency of 5Mbps I am suspecting rate limiting, but wanted to know if I was overlooking something else. -- Brian Raaen Network Engineer [EMAIL PROTECTED] signature.asc Description: This is a digitally signed message part.
Bandwidth issues in the Sprint network
I am currently having problems get upload bandwidth on a Sprint circuit. I am using a full OC3 circuit. I am doing fine on downloading data, but uploading data I can only get about 5Mbps with ftp or a speedtest. I have tested against multiple networks and this has stayed the same. Monitoring Cacti graphs and the router I do get about 30Mbps total traffic outbound, but individual (flows/ip?) test always seem limited. I would like to know if anyone else sees anything similar, or where I can get help. The assistance I have gotten from Sprint up to this point is that they find no problems. Due to the consistency of 5Mbps I am suspecting rate limiting, but wanted to know if I was overlooking something else. -- Brian Raaen Network Engineer [EMAIL PROTECTED] signature.asc Description: This is a digitally signed message part.
Re: rack power question
Russia (or the USSR at that time) used to use liquid graphite to cool their nuclear reactors, even thought it was flammable of course that was what they were using in Chernobyl. -- Brian Raaen Network Engineer [EMAIL PROTECTED] On Tuesday 25 March 2008, you wrote: Dorn Hetzel wrote: Of course, my chemistry is a little rusty, so I'm not sure about the prospects for a non-toxic, non-flammable, non-conductive substance with workable fluid flow and heat transfer properties :) Mineral oil? I'm not sure about the non-flammable part though. Not all oils burn but I'm not sure if mineral oil is one of them. It is used for immersion cooling though. Justin
ICMP being dropped between Global Crossings and Onvoy
I have a network (AS33234) I am trying to support that is downstream from Onvoy on one of their connections. Our monitoring equipment is located in AS4452. Our monitoring system is not able to ping their network through Onvoy. The block seems to be happening at either Global Crossings or Onvoy. We are able to reach them using any protocol other than an ICMP ping (We are able to traceroute). Does anyone else know about or see a similar block going on. I have attached part of a traceroute. 2 suwC6.gig3-1-4.qualitytech.com (216.154.207.145) [AS 20141] 0 msec 0 msec 4 msec 3 suw04-gig1-0-0.qualitytech.com (216.154.207.173) [AS 20141] 0 msec 0 msec 0 msec 4 gig6-2.suwangaeq01w.cr.deltacom.net (66.35.174.165) [AS 6983] 4 msec 0 msec 0 msec 5 * * * 6 pos5-0.atlngapk22w.cr.deltacom.net (66.35.174.101) [AS 6983] 0 msec 4 msec 0 msec 7 so-0-0-0.ar3.DAL1.gblx.net (64.208.169.141) [AS 3549] 4 msec 4 msec 4 msec 8 so1-0-0-622M.ar2.MIN1.gblx.net (67.17.71.34) [AS 3549] 44 msec 44 msec 44 msec 9 WBS-CONNECT-LLC-Minneapolis.ge-2-3-0.409.ar2.MIN1.gblx.net (64.215.81.82) [AS 3549] 44 msec 44 msec 44 msec 10 * * * 11 * * * 12 WikstromTel-7003.onvoy.net (137.192.32.30) [AS 5006] 52 msec 52 msec 56 msec -- Brian Raaen Network Engineer [EMAIL PROTECTED]
Re: Network Inventory Tool
I have not tried it, but this looks promising. http://metanav.uninett.no/ http://en.wikipedia.org/wiki/Network_Administration_Visualized Hope this helps -- Brian Raaen Network Engineer [EMAIL PROTECTED] On Monday 13 August 2007 23:31, Wguisa71 wrote: Guys, Does anyone known some tool for network documentation with: - inventory (cards, serial numbers, manufactor...) - documentation (configurations, software version control, etc) - topology building (L2, L3.. connections, layer control, ...) All-in-one solution and It don't need to be free. I'm just looking for some thing to control the equipments we have like routers from some sort of suppliers, etc... Marcio
Re: Problems with either Cisco.com or ATT?
I get the same thing in Atlanta. I can't pull up their site and it looks like my trace dies the same place as yours. [EMAIL PROTECTED]:~$ traceroute www.cisco.com traceroute to www.cisco.com (198.133.219.25), 30 hops max, 40 byte packets 1 gw_alpha.america.net (69.60.176.65) 1.618 ms 1.499 ms 1.559 ms 2 69.60.176.21 (69.60.176.21) 9.625 ms 9.461 ms 9.439 ms 3 gwF20.Edelta.america.net (69.60.160.1) 9.260 ms 9.113 ms 9.392 ms 4 66.0.192.194 (66.0.192.194) 16.189 ms 9.219 ms 9.234 ms 5 suwC6.gig3-1-4.qualitytech.com (216.154.207.145) 13.064 ms 9.316 ms 10.029 ms 6 suw04-gig1-0-0.qualitytech.com (216.154.207.173) 41.053 ms 9.432 ms 9.315 ms 7 gig5-1.suwangaeq00w.xr.deltacom.net (66.35.174.125) 34.815 ms 9.871 ms 25.280 ms 8 pos5-0.atlngapk22w.cr.deltacom.net (66.35.174.101) 19.050 ms 40.288 ms 13.137 ms 9 pos1-0.brhmalwd6aw.cr.deltacom.net (66.35.174.13) 17.860 ms 15.823 ms 15.881 ms 10 12.117.136.41 (12.117.136.41) 22.890 ms 18.614 ms 19.742 ms 11 tbr2.attga.ip.att.net (12.123.20.14) 76.260 ms 75.531 ms 75.004 ms 12 tbr1.dlstx.ip.att.net (12.122.2.89) 70.993 ms 70.863 ms 71.373 ms 13 tbr1.la2ca.ip.att.net (12.122.10.50) 74.889 ms 75.098 ms 74.921 ms 14 gar1.sj2ca.ip.att.net (12.122.2.249) 73.098 ms 72.969 ms 72.849 ms 15 * * -- Brian Raaen Network Engineer [EMAIL PROTECTED] On Wednesday 08 August 2007 14:17, Paul Ferguson wrote: No idea -- maybe just a hiccup? From my office in San Jose: %traceroute www.cisco.com Tracing route to www.cisco.com [198.133.219.25] over a maximum of 30 hops: [snip] 7 3 ms 3 ms 3 ms so-3-0-0.mpr2.sjc7.us.above.net [64.125.30.173] 8 3 ms 3 ms 3 ms above-att.sjc7.us.above.net [64.125.13.50] 9 7 ms 7 ms 7 ms tbr1.sffca.ip.att.net [12.123.12.2] 10 6 ms 6 ms 6 ms gbr5.sffca.ip.att.net [12.122.11.74] 11 6 ms 6 ms 6 ms gar1.sj2ca.ip.att.net [12.122.2.253] 12 *** Request timed out. 13 *** Request timed out. 14 * ^C From MIT: Tracing to: www.cisco.com 1 legacy26-0.default.csail.mit.edu (18.26.0.1) [AS3] 0 ms 0 ms 0 ms 2 kalgan.trantor.csail.mit.edu (128.30.0.245) [AS40] 0 ms 0 ms 0 ms 3 B24-RTR-2-CSAIL.MIT.EDU (18.4.7.1) [AS3] 0 ms 0 ms 0 ms 4 EXTERNAL-RTR-1-BACKBONE.MIT.EDU (18.168.0.18) [AS3] 1 ms 4 ms 2 ms 5 ge-6-23.car2.Boston1.Level3.net (4.79.2.1) [AS3356] 0 ms * 0 ms 6 * * ae-5-5.ebr1.NewYork1.Level3.net (4.69.132.250) [AS3356] 8 ms 7 ae-61-61.csw1.NewYork1.Level3.net (4.69.134.66) [AS3356] 10 ms 5 ms 16 ms 8 ae-13-69.car3.NewYork1.Level3.net (4.68.16.5) [AS3356] 67 ms 59 ms 58 ms 9 att-level3-oc192.NewYork1.Level3.net (4.68.127.150) [AS3356] 17 ms 127 ms 12 ms 10 tbr1.n54ny.ip.att.net (12.123.3.57) [] [MPLS: Label 31537 Exp 0] 80 ms 79 ms 79 ms 11 12.122.16.153 (12.122.16.153) [] [MPLS: Label 19 Exp 0] 76 ms 77 ms 77 ms 12 cr1.cgcil.ip.att.net (12.122.1.190) [] [MPLS: Label 1188 Exp 0] 77 ms 76 ms 77 ms 13 12.122.17.146 (12.122.17.146) [] [MPLS: Label 31051 Exp 0] 77 ms 78 ms 78 ms 14 tbr1.sffca.ip.att.net (12.122.10.6) [] [MPLS: Label 31320 Exp 0] 78 ms 78 ms 78 ms 15 gbr5.sffca.ip.att.net (12.122.11.74) [] [MPLS: Label 323 Exp 0] 72 ms 71 ms 71 ms 16 gar1.sj2ca.ip.att.net (12.122.2.253) [] 76 ms 76 ms 77 ms 17 * * * 18 * * * 19 * * * 20 * * * - ferg -- Fergie, a.k.a. Paul Ferguson Engineering Architecture for the Internet fergdawg(at)netzero.net ferg's tech blog: http://fergdawg.blogspot.com/
Re: Problems getting Cisco router and Motorola Nextlevel system to work together
This router has a G-1 engine with 512 DRAM. I would stop using IRB, but it appears that the way that motorola has implemented pvc's is very difficult to work around. The Molorola middleware is dynamically assigning the pvc. Yes... I have personly seen a CPE device change their vci after a period of time. The device did not change ports or anything else but was provisioned to a different vci after just sitting there. Thanks for the suggestions so far. -- Brian Raaen Network Engineer [EMAIL PROTECTED] On Tuesday 24 July 2007 16:25, you wrote: The router is currently configured to use IRB which is a hybrid process. The problems is that the IRB process is overloaded and is dropping traffic faster than it can process it. Which NPE is in this router? Basically, the 7200 has underpowered CPUs and if you force it to process switch, then it handles a LOT LESS packets per second than you might think. I expect that your config is forcing process switching rather than fast switching. The only three solutions are A) run less traffic through the 7200 so that process switching can cope B) stop using the feature that forces process switching C) replace the 7200 with a 7300 which will probably not have CPU issues. However, not knowing the specifics of what IRB is doing, I would advise you to test a replacement platform before committing to it. Oh well, maybe 4 solutions. If you are using a weak NPE such as NPE-200 you may be able to get some joy by upgrading to a more powerful one. For instance an NPE-400 should handle roughly twice the load of an NPE-200. --Michael Dillon
Re: Problems getting Cisco router and Motorola Nextlevel system to work together
The buffers are overloading and dropping traffic. With a Cisco TAC case, the tech had me increase the buffers so much it wasn't even funny. The only problem was about and hour after we tried to tune the buffers, things got very bad and I had clear them to default to stop a very ugly bigger outage. This system does indeed involve IPTV set top boxes. I am unable to use RBE since the PVC provisioning may change on the units and the VC would not match what the dhcp lease was originally on. The way that this Motorola system implements PVCs baffles me, it does not make any sense to me. They are dynamically changing the vci assigning it out of a pool, just like DHCP does with IPs. The circuits are not SVCs and the endpoint router is seeing things change so this is not SPVCs either. I am trying to think of a way the change this to work with RBE switching, but the dynamic PVCs are throwing a monkey wrench into things. Thank for the help. -- Brian Raaen Network Engineer [EMAIL PROTECTED] On Tuesday 24 July 2007 22:58, you wrote: We should probably move this over to cisco-nsp. I'd be interested to see a 'sh buffers' because if it's process switching that much data I bet the buffers are thrashing. I seem to remember working on something very similar to that 4 or 5 years ago when a customer has brigding over a bunch of ATM PVC's and they told me it was some type of IPTV set top box. We tuned the buffers really high so they didn't trim back and it worked. We also do some bridging under interrupt without process switching too last time I checked so some more data would be helpful. Move it over to [EMAIL PROTECTED] and we can help more on the Cisco side if you want. Rodney On Tue, Jul 24, 2007 at 09:25:49PM +0100, [EMAIL PROTECTED] wrote: The router is currently configured to use IRB which is a hybrid process. The problems is that the IRB process is overloaded and is dropping traffic faster than it can process it. Which NPE is in this router? Basically, the 7200 has underpowered CPUs and if you force it to process switch, then it handles a LOT LESS packets per second than you might think. I expect that your config is forcing process switching rather than fast switching. The only three solutions are A) run less traffic through the 7200 so that process switching can cope B) stop using the feature that forces process switching C) replace the 7200 with a 7300 which will probably not have CPU issues. However, not knowing the specifics of what IRB is doing, I would advise you to test a replacement platform before committing to it. Oh well, maybe 4 solutions. If you are using a weak NPE such as NPE-200 you may be able to get some joy by upgrading to a more powerful one. For instance an NPE-400 should handle roughly twice the load of an NPE-200. --Michael Dillon
Where did freeipdb IP utility site go?
I was trying to investigate some the ip management tools and followed the link www.freeipdb.org and was more than a little upset with what I found. This domain name apparently has been taken by a porn site that is wanting to auction it off. does anyone know if the project died or if it changed domain names. I have removed the reference to it in the wiki page, but there are other references to the site on the NANOG site. I am not sure who will need to remove the links, but they no longer point to an ip management tool. If the utility still exist I would be intersted in finding it, as I saw not able to dig it up on a quick Google search. -- Brian Raaen Network Engineer [EMAIL PROTECTED]
Problems getting Cisco router and Motorola Nextlevel system to work together
I am having some difficulties involving using a Cisco 7200 router to terminate ATM sessions from a motorola nextlevel IPTV system. The router is currently configured to use IRB which is a hybrid process. The problems is that the IRB process is overloaded and is dropping traffic faster than it can process it. I opened a case with Cisco TAC, and they recommended using RBE instead of IRB. While I have been trying to plan migrating the system to RBE I discovered that Motorola uses a concept called dynamic pvc's to assign the pvc's to the CPE devices (a IPTV unit that has a data port). The device uses two PVC's one for data and one for IPTV. The system dynamically assigns the PVCs when the CPE devices connects. This looks like it would not work with RBE, since the pvc can change before the dhcp lease expires. Having this router dropping traffic, has been causing severe problems for end users and is causing an ongoing system outage. I am currently trying to work with both Motorola and Cisco, however both vendors are blaming the problem on the other vendor. I am not sure what to do. Motorola says their system only works with IRB and Cisco says the router will not function with this size network using IRB. Has anyone else arrived at a working solution using a Cisco 7200 router to terminate a Motorola nextlevel system support approximately 2000-3000 end users. I would be extremely gratefull if anyone who has worked with this type of system could help shed some light on this problem. Thank you in advance. -- Brian Raaen Network Engineer braaen (at) zcorum (dot) com
