Re: 2M today, 10M with no change in technology? An informal survey.
[EMAIL PROTECTED] wrote: On Wed, Aug 29, 2007 at 06:48:43PM -0400, Jon Lewis wrote: On Mon, 27 Aug 2007, David Conrad wrote: For a few more months. What are upgrade cycles like again? How common are the MSFC2s? I think we'll find out in a few months, when the internet breaks in a whole bunch of places where the admins aren't aware of this issue or operations have been downsized to the point that things are mostly on auto-pilot. I'm guessing there are a good number of Sup2's in use, and that a good % of them think they're fine...as they have 512MB RAM and on the software based routers, that's plenty for current full BGP routes. private replies suggest (w/ lots of handwaving) that perhaps 20-35% of the forwarding engines in use might fit this catagory. Anyone want to bet there will be people posting to nanog and cisco-nsp in a few months asking why either the CPU load on their Sup2's has suddenly shot up or why they keep noticing parts of the internet have gone unreachable?...oblivious to this thread. that would be a sucker bet If Cisco could ship enough units when asked, I'd say their next couple of quarters are in the bag... but since they have such huge lead times. well, I am guessing a lot of people will start considering taking partial routes. Transit providers would do well to have a distribute-list or similar configured to offer these guys when they call rather than trying to engineer something on an ICB basis. Deepak
Re: 2M today, 10M with no change in technology? An informal survey.
On 8/28/07 5:11 PM, Lincoln Dale [EMAIL PROTECTED] wrote: agree that this isn't ideal, however Cisco has always been very specific about the h/w FIB adjacency table sizes on the hardware in question. i know that vendor bashing is a sport in this list, but The problem is that Cisco hasn't been forthcoming. To me it seems the data was hidden in a corner of a spec sheet. Meanwhile sales teams are still saying the PFC3B is acceptable for taking a full table. And the failure to produce a Sup32-3BXL or similar is also frustrating - I don't need Sup720 backplane speeds on my edge router. -- John A. Kilpatrick [EMAIL PROTECTED]Email| http://www.hypergeek.net/ [EMAIL PROTECTED] Text pages| ICQ: 19147504 remember: no obstacles/only challenges
Re: 2M today, 10M with no change in technology? An informal survey.
On Mon, 27 Aug 2007, David Conrad wrote: For a few more months. What are upgrade cycles like again? How common are the MSFC2s? I think we'll find out in a few months, when the internet breaks in a whole bunch of places where the admins aren't aware of this issue or operations have been downsized to the point that things are mostly on auto-pilot. I'm guessing there are a good number of Sup2's in use, and that a good % of them think they're fine...as they have 512MB RAM and on the software based routers, that's plenty for current full BGP routes. Anyone want to bet there will be people posting to nanog and cisco-nsp in a few months asking why either the CPU load on their Sup2's has suddenly shot up or why they keep noticing parts of the internet have gone unreachable?...oblivious to this thread. -- Jon Lewis | I route Senior Network Engineer | therefore you are Atlantic Net| _ http://www.lewis.org/~jlewis/pgp for PGP public key_
Re: 2M today, 10M with no change in technology? An informal survey.
On Wed, Aug 29, 2007 at 06:48:43PM -0400, Jon Lewis wrote: On Mon, 27 Aug 2007, David Conrad wrote: For a few more months. What are upgrade cycles like again? How common are the MSFC2s? I think we'll find out in a few months, when the internet breaks in a whole bunch of places where the admins aren't aware of this issue or operations have been downsized to the point that things are mostly on auto-pilot. I'm guessing there are a good number of Sup2's in use, and that a good % of them think they're fine...as they have 512MB RAM and on the software based routers, that's plenty for current full BGP routes. private replies suggest (w/ lots of handwaving) that perhaps 20-35% of the forwarding engines in use might fit this catagory. Anyone want to bet there will be people posting to nanog and cisco-nsp in a few months asking why either the CPU load on their Sup2's has suddenly shot up or why they keep noticing parts of the internet have gone unreachable?...oblivious to this thread. that would be a sucker bet -- Jon Lewis | I route --bill
Re: 2M today, 10M with no change in technology? An informal survey.
On Thu, Aug 30, 2007, [EMAIL PROTECTED] wrote: Anyone want to bet there will be people posting to nanog and cisco-nsp in a few months asking why either the CPU load on their Sup2's has suddenly shot up or why they keep noticing parts of the internet have gone unreachable?...oblivious to this thread. that would be a sucker bet I've started seeing it already occasionally. I've even seen one guy here upgrade from Sup2 to Sup32. Adrian
Re: 2M today, 10M with no change in technology? An informal survey.
On 8/27/07, Deepak Jain [EMAIL PROTECTED] wrote: an MSFC2 can hold 256,000 entries in its FIB of which 12,000 are reserved for Multicast. I do not know if the 12,000 can be set to serve the general purpose. The MSFC2 therefore can server 244,000 routes without uRPF turned on. I'm hit square on with this because I use Sup2's with the msfc2/pfc2 for the link to both of my transit providers. I took this up with the Cisco TAC overnight to find out where I stand. Here's what I found: 1. The msfc2/pfc2 does in fact have a limit that starts at 244,000 routes. 2. Once the limit is reached, excess routes will fail over to software switching. TAC did not specify how routes are designated as excess. 3. The Sup 720 (except for the 3bxl) has a similar limit, however the mls cef maximum-routes command can be used to make upwards of 260,000 TCAM entries available to IPv4 unicast routing. The Sup 2 does not support this command. 4. The suggested upgrade path is the Supervisor 720-3BXL whose TCAM can support up to 1M IPv4 FIB entries or 500k IPv6 FIB entries. With a 7600 (instead of a 6500) the RSP 720-3CXL can do the same and also has a faster processor, more memory, etc. Now, my request for help: I have a leaf node on the DFZ handled by a pair of Sup2's (pfc2/msfc2), two transit providers and several peers. My focus is very heavily domestic, and I'd like to delay my upgrade. I'd like to buy some time by aggregating the incoming APNIC region prefixes (http://www.iana.org/assignments/ipv4-address-space) into the following FIB entries: 58.0.0.0/7 60.0.0.0/7 116.0.0.0/6 120.0.0.0/6 124.0.0.0/7 126.0.0.0/8 202.0.0.0/7 210.0.0.0/7 218.0.0.0/7 220.0.0.0/7 222.0.0.0/8 Can anyone suggest how to program that into the router or refer me to the URL of the correct documentation at Cisco's site? Thanks in advance, Bill Herrin -- William D. Herrin [EMAIL PROTECTED] [EMAIL PROTECTED] 3005 Crane Dr.Web: http://bill.herrin.us/ Falls Church, VA 22042-3004
Re: 2M today, 10M with no change in technology? An informal survey.
On Tue, 28 Aug 2007 15:11:52 -0400 William Herrin [EMAIL PROTECTED] wrote: On 8/27/07, Deepak Jain [EMAIL PROTECTED] wrote: an MSFC2 can hold 256,000 entries in its FIB of which 12,000 are reserved for Multicast. I do not know if the 12,000 can be set to serve the general purpose. The MSFC2 therefore can server 244,000 routes without uRPF turned on. snip Now, my request for help: I have a leaf node on the DFZ handled by a pair of Sup2's (pfc2/msfc2), two transit providers and several peers. My focus is very heavily domestic, and I'd like to delay my upgrade. I'd like to buy some time by aggregating the incoming APNIC region prefixes (http://www.iana.org/assignments/ipv4-address-space) into the following FIB entries: 58.0.0.0/7 60.0.0.0/7 116.0.0.0/6 120.0.0.0/6 124.0.0.0/7 126.0.0.0/8 202.0.0.0/7 210.0.0.0/7 218.0.0.0/7 220.0.0.0/7 222.0.0.0/8 Can anyone suggest how to program that into the router or refer me to the URL of the correct documentation at Cisco's site? Probably better over at cisco-nsp, however I'd expect you'd use the aggregate-address prefix mask summary-only command to create aggregates, yet supressing them from being announced to any other BGP peer. I think that would still cause the more specifics to get into the FIB of the aggregating router, however there's a command I've only come across recently, under the router bgp section, which allows you to apply a route-map to routes as they go from the BGP RIB to the FIB. You might be able to use that to stop the more specifics getting into the FIB, with a route-map deny clause. The command is table-map. I haven't used it myself, and the command reference says that it's only to set attributes so YMMV. I haven't had success using deny clauses in BGP attribute setting route-maps, so it may not be possible at all to use this command for this purpose. Another way you might avoid the more specifics getting into the FIB is to only accept a few known or selected large more specifics from those ranges from your upstreams e.g. 3 or so, dropping the rest, and use those select few to create the /6-8 aggregates you'll use internally. Probably a bit more work than the table-map method, but if that doesn't work, this is probably the way to do it. (Looks like the coffee is just kicking in this morning - I've just come up with another way just before I send this off.) Or you could set up a route server upstream of your router with the limited FIB and do the filtering and / or aggregation there. As it isn't in the forwarding path, you could probably use a lower end software Cisco platform with enough CPU and RAM just to do the BGP processing e.g. probably something as low end as an 1800 series with 1GB of RAM (I'd suggest switching CEF off to save RAM) would be quite fine to do that job. I'd even suggest an 800 series (400MHz PowerPCs are no slouches), however they've only got a max of 256MB of RAM with probably isn't enough (for a bit of fun one day, I put the full route table in a 128MB one, but it only got to 140 000 routes before it ran out of RAM.) HTH, Mark. -- Sheep are slow and tasty, and therefore must remain constantly alert. - Bruce Schneier, Beyond Fear
Re: 2M today, 10M with no change in technology? An informal survey.
Bill, [...] 2. Once the limit is reached, excess routes will fail over to software switching. TAC did not specify how routes are designated as excess. I'm not sure if the Sup2's handle this case differently from the Sup720s we were using, but, in our case, when we reached the ceilign the routes appeared in both the routing and CEF tables but were not populated into the FIB. Translation: the route was ignored Eric :)
RE: 2M today, 10M with no change in technology? An informal survey.
[...] 2. Once the limit is reached, excess routes will fail over to software switching. TAC did not specify how routes are designated as excess. most-specific-prefixes first. it has to be this way due to the way a TCAM search works. I'm not sure if the Sup2's handle this case differently from the Sup720s we were using, but, in our case, when we reached the ceilign the routes appeared in both the routing and CEF tables but were not populated into the FIB. Translation: the route was ignored how old is the software you were running on your cat6k? reason i ask is that since circa. 12.2(18)SXF9 (i.e. back in 2005), there has been a graceful degradation back to software forwarding for those entries that don't fit into the FIB TCAM: - when the h/w FIB is full (FIB exception) it goes into exception state where it will maintain the longest-prefix-matches by removing shortest- prefix-matches from the FIB TCAM first - it will also insert a default entry to punt lookup exceptions to software - software typically CAN maintain a full FIB, so entries which don't fit into hardware can be software forwarded in the CEF software switching path - when the h/w FIB is full, the following syslog message is generated: MLSCEF-SP-7-FIB_EXCEPTION: FIB TCAM exception, Some entries will be software switched of course, software forwarding is potentially orders-of-magnitude slower than h/w forwarding, so how much extra headroom this gives you once you exceed the capabilities is dependent on the amount of traffic to those prefixes that don't fit into the h/w tables. agree that this isn't ideal, however Cisco has always been very specific about the h/w FIB adjacency table sizes on the hardware in question. i know that vendor bashing is a sport in this list, but relevant bug-ids if you wanted to look up the details: CSCse90572 syslog message when FIB TCAM exceeds 95% utilization CSCsb18172 wrong packet forwarding at FIB exception if you need further clarification, feel free to contact me off-list, my work email address is [EMAIL PROTECTED] cheers, lincoln. No virus found in this outgoing message. Checked by AVG Free Edition. Version: 7.5.484 / Virus Database: 269.12.10/977 - Release Date: 28-Aug-07 4:29 PM
RE: 2M today, 10M with no change in technology? An informal survey.
agree that this isn't ideal, however Cisco has always been very specific about the h/w FIB adjacency table sizes on the hardware in question. i know that vendor bashing is a sport in this list, but Can you please point out where I can find this information ... The only place I found information on the PFC3B was on a random page for the SUP 720-3B. I was completely unable to find the information on a Sup32 page. Now maybe my search technique isn't up to snuff- but I would hope I could find this information after searching for a couple of hours- I couldn't. I'm sure the information is on Cisco's site somewhere- but I honestly think that they could be a LOT more forward about it- rather then just very specific about it. -Don
RE: 2M today, 10M with no change in technology? An informal survey.
agree that this isn't ideal, however Cisco has always been very specific about the h/w FIB adjacency table sizes on the hardware in question. i know that vendor bashing is a sport in this list, but Can you please point out where I can find this information ... The Sup720 datasheet covers the capabilities (see http://www.cisco.com/en/US/products/hw/modules/ps2797/products_data_sheet09186a 0080159856.html). I got that (cisco.com) URL from the google search 'Supervisor 720 data sheet'. I agree that the Sup32 datasheet (http://www.cisco.com/en/US/products/hw/switches/ps708/products_data_sheet0900a ecd801c5cab.html) is less specific that it perhaps should be, but it does clearly talk about what policy feature card is onboard and from the same document hierarchy there is a link to 'Policy Feature Card-3B' which has the same data as the Sup720 datasheet on PFC3B. cheers, lincoln. NB. in my post there was a thinko, i incorrectly said most-specific-prefixes first, i meant least-specific-prefixes first.
RE: 2M today, 10M with no change in technology? An informal survey.
On Wed, 29 Aug 2007, Lincoln Dale wrote: reason i ask is that since circa. 12.2(18)SXF9 (i.e. back in 2005), there has One of the problems with this is that the people that have the tendency of not knowing their hardware limitations are the same people that will be running SXD because they haven't put CFs into their SUP:s to handle the larger image sizes of SXE and later. -- Mikael Abrahamssonemail: [EMAIL PROTECTED]
Re: 2M today, 10M with no change in technology? An informal survey.
Heya, My understanding is that there are no known algorithms for fast updates (and particularly withdrawals) on aggregated FIBs, especially if those FIBs are stored in CIDR form. This is the prime reason why all those Cisco 65xx/76xx with MSFC2/PFC2 will be worthless junk in a couple of months. Do we have a real date for when this occurs? If you aren't doing uRPF, I thought they ran up to 256,000 routes. (I may not recall correctly) We ran into this hiccup a few months ago on a Sup720-3B (well, a 3BXL which mistakenly had a 3B card in the chassis, causing the SUP to clock down and act like a 3B), but I think the Sup2's are in a similar situtation. Though the box can handle up to 224k routes, they are set by default to only handle 192k IPv4 + MPLS routes plus 32k IPv6 + IP multicast routes. You can retune this so that you can get up to 224k IPv4 routes, but I've recently seen our Internet table bumping against this. My understanding is that this is a hardware limit, so upgrading is your only option. Eric :)
Re: 2M today, 10M with no change in technology? An informal survey.
On Mon, 27 Aug 2007, Eric Gauthier wrote: Do we have a real date for when this occurs? If you aren't doing uRPF, I thought they ran up to 256,000 routes. (I may not recall correctly) We ran into this hiccup a few months ago on a Sup720-3B (well, a 3BXL which mistakenly had a 3B card in the chassis, causing the SUP to clock down and act like a 3B), but I think the Sup2's are in a similar situtation. Though the box can handle up to 224k routes, they are set by default to only handle 192k IPv4 + MPLS routes plus 32k IPv6 + IP multicast routes. You can retune this so that you can get up to 224k IPv4 routes, but I've recently seen our Internet table bumping against this. My understanding is that this is a hardware limit, so upgrading is your only option. The sup2 can actually handle a bit more ipv4 routes than the Sup720(non-3bxl). I don't know if it can go all the way to 256k routes. I can't seem to find any cisco data sheets that specify max ipv4 routes on the sup2. The output from show mls cef hardware suggests 256k is the limit. -- Jon Lewis | I route Senior Network Engineer | therefore you are Atlantic Net| _ http://www.lewis.org/~jlewis/pgp for PGP public key_
Re: 2M today, 10M with no change in technology? An informal survey.
According to this link, which alleges to be from cisco-nsp, an MSFC2 can hold 256,000 entries in its FIB of which 12,000 are reserved for Multicast. I do not know if the 12,000 can be set to serve the general purpose. The MSFC2 therefore can server 244,000 routes without uRPF turned on. Any reasonably valid way of predicting when we'll hit 244,000 routes in the default-free zone? http://osdir.com/ml/network.nsp.cisco/2002-08/msg00283.html Deepak
Re: 2M today, 10M with no change in technology? An informal survey.
On Aug 27, 2007, at 2:49 PM, Deepak Jain wrote: According to this link, which alleges to be from cisco-nsp, an MSFC2 can hold 256,000 entries in its FIB of which 12,000 are reserved for Multicast. I do not know if the 12,000 can be set to serve the general purpose. The MSFC2 therefore can server 244,000 routes without uRPF turned on. Any reasonably valid way of predicting when we'll hit 244,000 routes in the default-free zone? Um? Real Soon Now? According to http://www.cidr-report.org/as2.0/ we're at 233,000 routes (as seen from AS 2.0 now) and the rate of growth as seen from http://bgp.potaroo.net/ seems pretty steep. I must be missing something obvious (or should I be dusting off my unused Y2K survival gear?) Thanks, -drc
Re: 2M today, 10M with no change in technology? An informal survey.
David Conrad wrote: On Aug 27, 2007, at 2:49 PM, Deepak Jain wrote: According to this link, which alleges to be from cisco-nsp, an MSFC2 can hold 256,000 entries in its FIB of which 12,000 are reserved for Multicast. I do not know if the 12,000 can be set to serve the general purpose. The MSFC2 therefore can server 244,000 routes without uRPF turned on. Any reasonably valid way of predicting when we'll hit 244,000 routes in the default-free zone? Um? Real Soon Now? According to http://www.cidr-report.org/as2.0/ we're at 233,000 routes (as seen from AS 2.0 now) and the rate of growth as seen from http://bgp.potaroo.net/ seems pretty steep. I must be missing something obvious (or should I be dusting off my unused Y2K survival gear?) I found that, eventually. I'm only seeing about 227K routes, but customer routes from wherever the CIDR report is getting data could be part of the difference. Where do the FIBs break on older 12000 series and M-series routers? (or pick the *next* most popular piece of network equipment that is used in full-routes scenarios). Maybe I should take a whack at my aggregation idea on an MSFC2 to see how it does. Hmmm.. Deepak
Re: 2M today, 10M with no change in technology? An informal survey.
On Mon, 27 Aug 2007, David Conrad wrote: Any reasonably valid way of predicting when we'll hit 244,000 routes in the default-free zone? Um? Real Soon Now? ... I must be missing something obvious (or should I be dusting off my unused Y2K survival gear?) Unlike Y2K, the end of the useful service life up the Sup2 can easily be pushed further away in time. ASnum NetsNow NetsAggrNetGain % GainDescription Table 233651151129 82522 35.3% All ASes AS4134 1337 339 998 74.6% CHINANET-BACKBONE No.31,Jin-rong Street AS18566 1020 101 919 90.1% COVAD - Covad Communications Co. AS4323 1315 437 878 66.8% TWTC - Time Warner Telecom, Inc. AS4755 1331 507 824 61.9% VSNL-AS Videsh Sanchar Nigam Ltd. Autonomous System There's really only 151129 routes you need to have full routes. Forcing just these top 4 slobs to aggregate reduces your global table by 3619 routes. Forcing the top 30 to aggregate frees up 15809 routes. Of course there are other reasons to upgrade (better CPU, MPLS, IPv6, etc.), but if you can't upgrade, there are alternatives to stretch the old hardware. It's not like it hasn't been done before. -- Jon Lewis | I route Senior Network Engineer | therefore you are Atlantic Net| _ http://www.lewis.org/~jlewis/pgp for PGP public key_
Re: 2M today, 10M with no change in technology? An informal survey.
Jon, On Aug 27, 2007, at 5:50 PM, Jon Lewis wrote: Any reasonably valid way of predicting when we'll hit 244,000 routes in the default-free zone? Real Soon Now? According to Geoff, the BGP table is growing at around 3500 routes per month, so we're looking at blowing out MSFC2s in about 3 months if nothing changes. And here I was, wondering about 2M routes... Unlike Y2K, the end of the useful service life up the Sup2 can easily be pushed further away in time. Easy is, I suspect, in the mind of the route injector. There's really only 151129 routes you need to have full routes. Forcing just these top 4 slobs to aggregate reduces your global table by 3619 routes. ~1 more month. Forcing the top 30 to aggregate frees up 15809 routes. ~3 more months. Of course there are other reasons to upgrade (better CPU, MPLS, IPv6, etc.), but if you can't upgrade, there are alternatives to stretch the old hardware. For a few more months. What are upgrade cycles like again? How common are the MSFC2s? It's not like it hasn't been done before. Yep. The nice thing about repeating history is you have a good idea of the whinage that you're in store for. CIDR Wars 2.0: This Time It's For Real! No, really. We mean it this time. :-) Regards, -drc I used to be disgusted, now I try to be amused ... -- Elvis Costello
Re: 2M today, 10M with no change in technology? An informal survey.
On Mon, 27 Aug 2007, Jon Lewis wrote: Of course there are other reasons to upgrade (better CPU, MPLS, IPv6, etc.), Now if this was a dust old MSFC2 that was like 5 years old I'd say ok. The problem is twofold: 1. Cisco is still selling the 7600 with the Sup32 bundle (which is what we bought) and saying you can take a full route table on it. I could already do MPLS and IPv6 on this box. This is pretty new hardware. 2. The only thing I could buy is the top of the line Sup720 3BXL. Ok, fine, but I don't need mega-super-d00per backplane speed. I just need more TCAM like Christoper Walken needs more cowbell. Cisco needs to have a reasonable solution to this problem - especially if they want to keep selling the 7600 as a router. If I end up upgrading because of this it will probably be a forklift upgrade to another platform. And there's no guarantee that it would be a Cisco one. -- John A. Kilpatrick [EMAIL PROTECTED]Email| http://www.hypergeek.net/ [EMAIL PROTECTED] Text pages| ICQ: 19147504 remember: no obstacles/only challenges
Re: 2M today, 10M with no change in technology? An informal survey.
At 8:50 PM -0400 8/27/07, Jon Lewis wrote: Unlike Y2K, the end of the useful service life up the Sup2 can easily be pushed further away in time. ASnum NetsNow NetsAggrNetGain % GainDescription There's really only 151129 routes you need to have full routes. Forcing just these top 4 slobs to aggregate reduces your global table by 3619 routes. Forcing the top 30 to aggregate frees up 15809 routes. That's an additional ~5 months at the current rate of new routes (and current ratio of customers per new routed block.) There's a lot more than 3500 new customers per month globally and if we get to the point where they are not coming out of hierarchical PA space, the new monthly routing growth will increase dramatically. /John
Re: 2M today, 10M with no change in technology? An informal survey.
On Tue, 28 Aug 2007, Chris L. Morrow wrote: On Mon, 27 Aug 2007, John A. Kilpatrick wrote: a reasonable solution to this problem - especially if they want to keep selling the 7600 as a router. and here I always looked at the 6500 as a switch... And the 7600 is a router? :) -- Jon Lewis | I route Senior Network Engineer | therefore you are Atlantic Net| _ http://www.lewis.org/~jlewis/pgp for PGP public key_
Re: 2M today, 10M with no change in technology? An informal survey.
On Mon, 27 Aug 2007, John A. Kilpatrick wrote: a reasonable solution to this problem - especially if they want to keep selling the 7600 as a router. and here I always looked at the 6500 as a switch...
Re: 2M today, 10M with no change in technology? An informal survey.
On Mon, 27 Aug 2007, John A. Kilpatrick wrote: 1. Cisco is still selling the 7600 with the Sup32 bundle (which is what we bought) and saying you can take a full route table on it. I could already do MPLS and IPv6 on this box. This is pretty new hardware. Where are they saying that? The Sup32 sounded great until it became clear that it came with PFC3B (not 3BXL), and that there was no upgrade path to 3BXL. If it was/is being sold as a BGP routing solution, it was awfully short sighted. 2. The only thing I could buy is the top of the line Sup720 3BXL. Ok, fine, but I don't need mega-super-d00per backplane speed. I just need more TCAM like Christoper Walken needs more cowbell. Cisco needs to have a We're in the same boat. According to show catalyst6000, our Sup2's are doing just fine. If there were a Sup32-3BXL, it'd be more than sufficient for our needs. If I end up upgrading because of this it will probably be a forklift upgrade to another platform. And there's no guarantee that it would be a Cisco one. I guess cisco wants to play chicken with us and Juniper. Will you really do the forklift, or just bite the bullet and go Sup720-3BXL? I think they're better on the latter and counting on a bunch of hardware sales in the coming months. -- Jon Lewis | I route Senior Network Engineer | therefore you are Atlantic Net| _ http://www.lewis.org/~jlewis/pgp for PGP public key_
Re: 2M today, 10M with no change in technology? An informal survey.
On Tue, 28 Aug 2007, Chris L. Morrow wrote: On Tue, 28 Aug 2007, Chris L. Morrow wrote: On Mon, 27 Aug 2007, John A. Kilpatrick wrote: a reasonable solution to this problem - especially if they want to keep selling the 7600 as a router. and here I always looked at the 6500 as a switch... And the 7600 is a router? :) I thought it was just a 6500 that sommeone got drunk and tipped over on it's side, like a cow... And tagged with some white paint. Though if you've kept up with the latest IOS developments, cisco is finally differentiating the platforms we've assumed for years were only different in angle and paint. 6500's won't get to run the newest 7600 code. -- Jon Lewis | I route Senior Network Engineer | therefore you are Atlantic Net| _ http://www.lewis.org/~jlewis/pgp for PGP public key_
Re: 2M today, 10M with no change in technology? An informal survey.
On Mon, 27 Aug 2007, Jon Lewis wrote: On Tue, 28 Aug 2007, Chris L. Morrow wrote: On Mon, 27 Aug 2007, John A. Kilpatrick wrote: a reasonable solution to this problem - especially if they want to keep selling the 7600 as a router. and here I always looked at the 6500 as a switch... And the 7600 is a router? :) I thought it was just a 6500 that sommeone got drunk and tipped over on it's side, like a cow...
Re: 2M today, 10M with no change in technology? An informal survey.
On Tue, 28 Aug 2007, Chris L. Morrow wrote: And the 7600 is a router? :) I thought it was just a 6500 that sommeone got drunk and tipped over on it's side, like a cow... I still needle my Cisco rep about that from time to time. IMHO, the 6500/7600 split was one of the dumbest, most poorly thought-out decisions Cisco ever made. That and they still haven't given me the warm-and-fuzzy about the plans for IOS licensing. Where I work, we're heavily invested in 6500s in the core and I don't see that changing any time soon. The borders are Junipers because they 'just plain work' :) jms
Re: 2M today, 10M with no change in technology? An informal survey.
On 8/27/07, Justin M. Streiner [EMAIL PROTECTED] wrote: I thought it was just a 6500 that sommeone got drunk and tipped over on it's side, like a cow... http://farm.tucows.com/images/2006/07/cow_tipping.jpg :D
Re: 2M today, 10M with no change in technology? An informal survey.
On Mon, 27 Aug 2007, Jon Lewis wrote: On Tue, 28 Aug 2007, Chris L. Morrow wrote: I thought it was just a 6500 that sommeone got drunk and tipped over on it's side, like a cow... And tagged with some white paint. Though if you've kept up with the latest IOS developments, cisco is finally differentiating the platforms we've assumed for years were only different in angle and paint. 6500's won't get to run the newest 7600 code. Oh poor cow :( In all seriousness though, most routing platforms have their costs and benefits. The 7600/6500 do some things nicely, apparently large FIB's aren't their strength though (in most deployed configs atleast). -Chris
Re: 2M today, 10M with no change in technology? An informal survey.
1. Cisco is still selling the 7600 with the Sup32 bundle (which is what we bought) and saying you can take a full route table on it. I could already do MPLS and IPv6 on this box. This is pretty new hardware. Where are they saying that? The Sup32 sounded great until it became clear that it came with PFC3B (not 3BXL), and that there was no upgrade path to 3BXL. If it was/is being sold as a BGP routing solution, it was awfully short sighted. Their reps do it all the time. I worked with my rep to buy a couple of new routers. I specifically said I would be taking a full routing table on these boxes- Cisco's rep said the Sup-32 would be fine for my needs. Now I definitely didn't do as much checking as I should have but I was busy and that's why you have rep's in the first place. (I kept thinking the Sup32 was based on the 3BXL- I have no idea why). Thankfully I don't need to take a full table on these routers and their forwarding speed among the few ports I have is more important than the FIB size. That said- if I did need the full table I would be royally ticked off at Cisco right now. If I end up upgrading because of this it will probably be a forklift upgrade to another platform. And there's no guarantee that it would be a Cisco one. I guess cisco wants to play chicken with us and Juniper. Will you really do the forklift, or just bite the bullet and go Sup720-3BXL? I think they're better on the latter and counting on a bunch of hardware sales in the coming months. Given how many people are tired of being screwed over by Cisco I wouldn't make that bet if I were Cisco. -Don
NANOG Humour (Re: 2M today, 10M with no change in technology? An informal survey.)
On Mon, 27 Aug 2007, Hex Star wrote: On 8/27/07, Justin M. Streiner [EMAIL PROTECTED] wrote: I thought it was just a 6500 that sommeone got drunk and tipped over on it's side, like a cow... http://farm.tucows.com/images/2006/07/cow_tipping.jpg :D While its occasionally amusing, can we please keep the humour to the minimum, while sticking to the operational content? -alex (mlc chair)
Re: 2M today, 10M with no change in technology? An informal survey.
On 8/27/07 7:36 PM, Chris L. Morrow [EMAIL PROTECTED] wrote: and here I always looked at the 6500 as a switch... It switches, it routes, it makes julienne fries... -- John A. Kilpatrick [EMAIL PROTECTED]Email| http://www.hypergeek.net/ [EMAIL PROTECTED] Text pages| ICQ: 19147504 remember: no obstacles/only challenges
Re: 2M today, 10M with no change in technology? An informal survey.
On Mon, 27 Aug 2007, Jon Lewis wrote: Though if you've kept up with the latest IOS developments, cisco is finally differentiating the platforms we've assumed for years were only different in angle and paint. 6500's won't get to run the newest 7600 code. I think Cisco is coming to their senses. SXH has *most* of SRB features, while (hopefully) more stable. At this point, imho, the rsp720 is getting the short end of the stick, because it is only limited to SRB+, while you have a choice of SX* and SRB on the sup720. But I think, imho, this discussion belongs to cisco-nsp more than to nanog-l. -alex [not speaking as mlc blah blah]
Re: 2M today, 10M with no change in technology? An informal survey.
On 8/27/07 9:39 PM, Donald Stahl [EMAIL PROTECTED] wrote: Thankfully I don't need to take a full table on these routers and their forwarding speed among the few ports I have is more important than the FIB size. That said- if I did need the full table I would be royally ticked off at Cisco right now. Well the way I'm putting it to my Cisco rep is Why should I invest in 3BXLs instead of another vendor's solution? I'm saying this repeatedly. Maybe they'll get the hint. I won't throw away the 7604s...I could totally redeploy them in my corporate infrastructure. At this point they really are Cat 6500s. I don't mind if they make a 7600-only train as long as the 7600s can still run 6500 code then at least it makes them useful. Just not as edge routers. I bet Juniper is lulzing this hardcore. -- John A. Kilpatrick [EMAIL PROTECTED]Email| http://www.hypergeek.net/ [EMAIL PROTECTED] Text pages| ICQ: 19147504 remember: no obstacles/only challenges
Re: 2M today, 10M with no change in technology? An informal survey.
On Mon, 27 Aug 2007, Deepak Jain wrote: Where do the FIBs break on older 12000 series and M-series routers? (or pick the *next* most popular piece of network equipment that is used in full-routes scenarios). On the 12000, I'd give the following observations on the state of the older linecards for DFZ routing: GRP that can't handle 512 meg memory has been useless for quite some time. GRP-B with 512 megs of ram seems ok for at least 6-12 more months. PRP needs 1 gig of ram. All LCs need at least 256 megs of route memory. 4GE engine3 LC needs 512 megs of route memory. 10x1GE Engine 4 LC needs 512 megs of route memory. Engine2 LCs are starting to run out of forwarding resources, cisco states 200k routes, but obviously they still work, but for how long? Otoh the SIP-601 comes with 2 gigs of route memory, which is really nice. The 12000 with recent hardware will most likely last quite some time, but the hardware designed in the late 90ties is (not strangely) running out of steam. So if you have old hardware, you need to monitor your memory and table utilization on a monthly basis. -- Mikael Abrahamssonemail: [EMAIL PROTECTED]
Re: 2M today, 10M with no change in technology? An informal survey.
My understanding is that there are no known algorithms for fast updates (and particularly withdrawals) on aggregated FIBs, especially if those FIBs are stored in CIDR form. This is the prime reason why all those Cisco 65xx/76xx with MSFC2/PFC2 will be worthless junk in a couple of months. Do we have a real date for when this occurs? If you aren't doing uRPF, I thought they ran up to 256,000 routes. (I may not recall correctly) Fast withdrawals.. We don't have instantaneous convergence right now, are you sure you aren't talking about easy withdrawals (as in, lots of compute time required per adjustment). MPLS environments would have additional entries where they are doing something with VRF or MPLS... the nodes in between wouldn't see anything as normal. For example, a router with only 1 connection (no matter how many routes being sent by its upstream), would only have 1 route entered into its FIB -- because no matter where the route goes, it can go upstream. This will cause routing loops for unallocated address space. This would be addressed in the bogon case. Deepak Jain
