Re: Partial Outage with TW Telecom and CenturyLink
Already on outages. On 4/24/2012 11:28 AM, Christopher Morrow wrote: this belongs on outages@ no? On Tue, Apr 24, 2012 at 12:14 PM, Chris Gotstein wrote: CenturyLink is reporting core routing issues at this time. Seeing the same issues with our DS-3, BGP stayed up, but traffic was not passing over the line. Had to manually shutdown the interface to get traffic flowing over our other providers link. What a mess. On 4/24/2012 8:22 AM, Eric C. Miller wrote: Morning Everyone, Yesterday between about 1900 and 2230 UTC, we had a partial drop with reaching various sites through TW Telecom from our circuit in Orlando, FL. The unavailable sites included Facebook, Newegg, and Godaddy. The outage did not affect our Atlanta TW Telecom. I confered with a colleague who manages a large customer in Apopka who said that they appeared not to be affected. His circuit and ours loop to the same TW Telecom POP. But even more Murphy than that, our Centurylink secondary circuit was having a routing loop issue at the same time, so while our BGP routes were being advertised to world through Centurylink, the circuit was useless. Centurylink aknowledged the existence of a bigger transport issue and said that we weren't the only customer affected. Anybody else notice these issues or have any other insight? Thanks! Eric Miller -- Chris Gotstein, Network Engineer, U.P. Logon/Computer Connection U.P. http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com -- Chris Gotstein, Network Engineer, U.P. Logon/Computer Connection U.P. http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com
Re: Partial Outage with TW Telecom and CenturyLink
CenturyLink is reporting core routing issues at this time. Seeing the same issues with our DS-3, BGP stayed up, but traffic was not passing over the line. Had to manually shutdown the interface to get traffic flowing over our other providers link. What a mess. On 4/24/2012 8:22 AM, Eric C. Miller wrote: Morning Everyone, Yesterday between about 1900 and 2230 UTC, we had a partial drop with reaching various sites through TW Telecom from our circuit in Orlando, FL. The unavailable sites included Facebook, Newegg, and Godaddy. The outage did not affect our Atlanta TW Telecom. I confered with a colleague who manages a large customer in Apopka who said that they appeared not to be affected. His circuit and ours loop to the same TW Telecom POP. But even more Murphy than that, our Centurylink secondary circuit was having a routing loop issue at the same time, so while our BGP routes were being advertised to world through Centurylink, the circuit was useless. Centurylink aknowledged the existence of a bigger transport issue and said that we weren't the only customer affected. Anybody else notice these issues or have any other insight? Thanks! Eric Miller -- Chris Gotstein, Network Engineer, U.P. Logon/Computer Connection U.P. http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com
Re: Motorola Canopy & Prizm
May want to join the animal farm list which is a group of WISPs that run canopy systems. http://www.afmug.com/the-group On 8/24/2010 9:44 AM, Alan Bryant wrote: I'm looking for some help with Motorola's Prizm software which is used for provisioning of subscriber modules with their Canopy wireless products. We are having some issues with authentication of some customer's and I believe it to be related to the management software (Prizm). Is there anyone on this list with experience with this software? -- ---- Chris Gotstein, Network Engineer, U.P. Logon/Computer Connection U.P. http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com
Re: Hardware for 50Mbs BGP feed.WAS Rate Limiting on Cisco Router
I think a 7200VXR with NPE-G1 that has 1Gb of ram would work just fine for you. We are running a very similar setup, passing about 70Mbs, full BGP routes, 2 providers and ACLs, only seeing about 20% usage on the CPU at peak times. Chris Gotstein, Network Engineer, U.P. Logon/Computer Connection U.P. http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com On 7/9/2010 11:43 AM, Dylan Ebner wrote: > Yesterday we took possession of a free 50Mb connection upgrade from one of > our ISPs. The previous connection was 30Mbps with a partial route table via > BGP. Other than BGP, the only other complex functions the router performs is > access listing the CRYMU Team Bogon table and traffic shaping. We terminate > this into a 2811 running 12.4 with 512MB of memory. When the Access lists > were applied we peaked the connection at 39Mbps and when the access list was > removed we peaked at 43.5Mbps. The CPU was pegged at 65% with the acl and 50% > without. Given the recent discussion about 80Mbps and a 7200, what would > members here recommend for a 50Mb connection that we expect to grow to 100Mb > in the next 18 months. We are also planning on adding netflow collection in > the next year as well. > > We were think of upgrading to a 3900 series, but it sounds like maybe we > should be thinking bigger? > > Also, how do members determine if their routers are overloaded. Besides > looking at memory and CPU usage are their other statistics they look at? Are > their third party tools that provide some insight into the routers condition? > > > > Dylan Ebner > > -Original Message- > From: Alan Bryant [mailto:a...@gtekcommunications.com] > Sent: Thursday, July 08, 2010 8:33 PM > To: gordsla...@ieee.org > Cc: Murphy, Jay, DOH; nanog@nanog.org > Subject: Re: Rate Limiting on Cisco Router > > So you guys would not recommend the traffic shaping route on a 7206 > with a NPE-G1? Is it the processor or memory that would not be able to > handle it? > > I don't necessarily plan on doing anything other than limiting it at > 80Mbps or whatever it is that we are capping ourselves at at the time. > > On Thu, Jul 8, 2010 at 7:13 PM, gordon b slater wrote: >> On Thu, 2010-07-08 at 18:54 -0500, Jack Bates wrote: >>> underpowered router or poor code >> >> Agreed. So which is it? :) >> >> To be fair, some IOS versions were better than others at it in my >> limited experience of that chassis. >> >> Gord >> -- >> I hold you XAP >> >> >> >> > > >
Re: Mikrotik & OC-3 Connection
12.4 Service provider has IPv6 and OSPFv3. On 7/3/2010 8:09 PM, Ray Burkholder wrote: I believe that IOS 12.4.25c is the latest version for the 7200VXR series. It's stable, been running it for quite some time. Depending on what you will be doing with this router, will depend on what feature set you'll want. I typically use the Service Provider IOS with IPSEC, 3DES and Lawful Intercept. We plan on doing BGP on the WAN side and BGP or OSPF on the LAN side. I'm assuming that I will need to upgrade the RAM on this router. Would The 15.0 series is available for the 7200VXR. However, unless I'm missing something, note that the Service Provider version doesn't have OSPFv3 for IPv6.You have to go with the Advanced IP series for that. Ray -- Chris Gotstein Sr Network Engineer UP Logon/Computer Connection UP 500 N Stephenson Ave Iron Mountain, MI 49801 Phone: 906-774-4847 Fax: 906-774-0335 ch...@uplogon.com
Re: Mikrotik & OC-3 Connection
Do you plan on getting full BGP routes from your upstream? If so, go with 1Gb of ram on the NPE G1. I believe that IOS 12.4.25c is the latest version for the 7200VXR series. It's stable, been running it for quite some time. Depending on what you will be doing with this router, will depend on what feature set you'll want. I typically use the Service Provider IOS with IPSEC, 3DES and Lawful Intercept. On 7/3/2010 7:51 PM, Alan Bryant wrote: Ok, scenario time. I've found a 7206VXR\NPE-G1 w/ 256MB RAM. It has the 3 onboard GigE ports and a PA-POS-1OC3 card in it that should be fine for our OC-3 connection. We need a total of 5 Ethernet ports, not necessarily all GigE. I found this card, PA-2FE-TX that would give us 2 10/100 ports. Everything that I have seen says this should work with the above router. Can anyone confirm this for me? We plan on doing BGP on the WAN side and BGP or OSPF on the LAN side. I'm assuming that I will need to upgrade the RAM on this router. Would I need to upgrade it all the way to the 1GB that it can take? From what i can tell it is not that expensive for the RAM, so we might as well. Will the following IOS version allow us to do all of the above? Cisco IOS Software, 7200 Software (C7200-IS-M), Version 12.4(12), RELEASE SOFTWARE (fc1) I'm finding it difficult to figure out the IOS versions and what is compatible from Cisco's website. Is this the highest IOS that this router can run? Thank you all for all the incredible help. Hopefully I will be able to repay the community at some point. On Sat, Jul 3, 2010 at 7:25 PM, Seth Mattinen wrote: On 7/3/2010 17:12, Majdi S. Abbas wrote: On Sat, Jul 03, 2010 at 07:32:48PM -0400, Scott Berkman wrote: I really wouldn't use the word legacy to describe SONET and OC-3's. It's around 25 years old (work started in 1985, first standards published in 1988) and we now have a ratified 100G Ethernet standard. Much of it is being used to transport subrate links, some of which are derived from even older transport standards. If not legacy, what word WOULD you use? I'd start calling it legacy when it's as easy to order from your telco as X.25 would be. I still see Ethernet circuits delivered via OC-3/STM-1 today with an Overture. If you're throwing OC-3 into the legacy bin you might as well call OC-192 and OC-768 legacy as well. Big deal if the standard is old, apparently it's still useful enough that there isn't a replacement yet. ~Seth -- Chris Gotstein Sr Network Engineer UP Logon/Computer Connection UP 500 N Stephenson Ave Iron Mountain, MI 49801 Phone: 906-774-4847 Fax: 906-774-0335 ch...@uplogon.com
Re: Hotmail bouncing email
We had a customer of ours call and ask the same thing this week. They run their own Exchange server, and they were getting delivery failed or delayed to Hotmail account. Issues started on Monday and I as far as i know, the issue went away yesterday. Chris Gotstein, Sr Network Engineer, UP Logon/Computer Connection UP http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com On 4/23/2010 9:09 AM, Greg Estabrooks wrote: > > > Is anyone else out there getting reports of hotmail randomly bouncing > emails with just a message of "failed"? > > Over the last 2 weeks we've had a dozens of complaints of hosting > customers spanning dozens of domains not receiving emails from hotmail > users. Checking our logs shows the messages were never even attempted > to be delivered and all forwarded in bounce messages literally just say > "Delivery failed", yet we are still happily processing thousands of > other emails from hotmail everyday. > > Now I'm wondering if this is restricted to us in someway or part of a > larger problem. > > >
Mail List Test
Haven't gotten a message through the NANOG mailing list for a week or so now. Seeing if this works. -- Chris Gotstein, Sr Network Engineer, UP Logon/Computer Connection UP http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com
Re: IPv6 enabled carriers?
We are getting native IPv6 from HE and Qwest at this time. Qwest was doing a beta of IPv6 that we were (are) a part of. Not sure of they have ended the beta and rolled out to production. Chris Gotstein, Sr Network Engineer, UP Logon/Computer Connection UP http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com On 3/10/2010 1:00 PM, Charles Mills wrote: > Does anyone have a list of carriers who are IPv6 capable today? > > I would assume this would be rolled out in larger cities first but > anything outside of "testbed environments" and "trials" as in > Comcast's recent announcement seems to be all that is available. > > I'm being tasked with coming up with an IPv6 migration plan for a data center. > > Mostly interested in if ATT, Level3, GLBX, Saavis, Verizon Business > and Qwest are capable as those are the typical ones I deal with. > > > Thanks...Chuck >
Cymru Bogon Route Help
I'm in the process of trying to setup bgp peering with Cymru to receive the bogon route list. I've got everything setup using the examples they have listed, but can't get the filtering to actually work on the incoming bgp. Using a Cisco 7200 router. Any off-list help would be appreciated. Thanks. -- ---- Chris Gotstein, Sr Network Engineer, UP Logon/Computer Connection UP http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com
Re: Comcast IPv6 Trials
Typically the CPE address is private, not sure why they would use a public IP. The MTA (VoIP) part of the modem would need a public IP if it was talking to a SIP server that was not on the same network. Most smaller cable system outsource their VoIP to a reseller with a softswitch. Chris Gotstein, Sr Network Engineer, UP Logon/Computer Connection UP http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com On 1/28/2010 7:44 AM, Joakim Aronius wrote: > * Paul Stewart (pstew...@nexicomgroup.net) wrote: >> That really makes sense - on an incredibly smaller scale (and I mean MUCH >> smaller scale), we operate cable modem in two small communities - currently >> we use 3 IP addresses per subscriber. One for the cable modem itself, one >> for the subscriber (or more depending on their package), and one for voice >> delivery (packetcable). If we moved even two of three IP assignments to >> native V6 we'd reclaim a lot of V4 space - I can only imagine someone their >> size and what this means... >> >> Paul > > Excuse the newbie question: Why use public IP space for local CPE management > and VoIP? Doesn't DOCSIS support traffic separation? > > /J >
Re: Consumer Grade - IPV6 Enabled Router Firewalls.
A Mikrotik Routerboard supports IPv6. Fairly cheap, under $100. But not easy enough for a novice home user to configure on their own. Could be a good cpe if it was pre-configured from the service provider though. I use a MT box at home which serves as my router, dual stack, and then set's up an IPv6 tunnel to SIXXS. Very stable platform. Only drawback is the lack of support for IPv6 over PPP. -- Chris Gotstein Sr Network Engineer UP Logon/Computer Connection UP Iron Mountain, MI 49801 Wade Peacock wrote: We had a discussion today about IPv6 today. During our open thinking the topic of client equipment came up. We all commented that we have not seen any consumer grade IPv6 enable internet gateways (routers/firewalls), a kin to the ever popular Linksys 54G series, DLinks , SMCs or Netgears. Does anyone have any leads to information about such products (In production or planned production)? We are thinking that most vendors are going to wait until Ma and Pa home user are screaming for them. Thoughts?
ESPN360 Access
We've been getting more and more requests for ESPN360 from our customers. From what i understand, ESPN requires that the ISP "subscribe" to their content and pay a fee to do so. I have been unable to find much information on what it takes to subscribe and what the fees are to do so. Does anyone have more info on ESPN360? Thanks. -- ---- Chris Gotstein, Sr Network Engineer, UP Logon/Computer Connection UP http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com
Re: NetFlow analyzer software
Not sure if this will get you all the info you are looking for, but it's open source and works well for our needs. http://nfsen.sourceforge.net/ Chris Gotstein, Sr Network Engineer, UP Logon/Computer Connection UP http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com Michael J McCafferty wrote: > All, >I am looking for decent netflow analyzer and reporting software with good > support for AS data. >ManagEngine's product crashes or locks up my browser when I try to > list/sort the AS info because it's too large of a list and there is no way to > tell it to show just the top x results. >Plixer's Scrutenizer, while it seems like it's a pretty decent product, is > no longer supporting Linux... We are a Linux shop (servers, desktops, > laptops). >What else is there that I might want to look at? > > Thanks! > Mike > M5Hosting.com > Sent from my Verizon Wireless BlackBerry >
Re: IPv6 in the ARIN region
We are running IPv6 over 209 currently. 2607:F8E8::/32 Chris Gotstein, Sr Network Engineer, UP Logon/Computer Connection UP http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com David Temkin wrote: > I contacted 209 yesterday (due to the ongoing Cogent/174 silliness) and it > seems like they are willing to turn up customer-facing v6, but have made it > a sales process (versus a technical request) and so that complicates things. > > -Dave > > On Tue, Oct 13, 2009 at 8:27 AM, Seth Mattinen wrote: > >> New thread: who will route the full IPv6 table? So far I'm seeing PI >> /48's out of 2620:0:/23 from: >> >> NTT, 2914 >> AT&T, 7018 >> Sprint, 1239 and 6175 >> Hurricane, 6939 >> Level 3, 3356 >> Global Crossing, 3549 >> Qwest, 209 >> >> Did I miss anyone? Qwest only carries one route (out of 4 total) though, >> don't know if that's an exception or they only have one ARIN PI customer. >> >> ~Seth >> >>
Re: Gmail Down?
We don't use gmail for any of our services, but a lot of our ISP customers use gmail. So when they see gmail being down, they assume that their internet connection is down or that we are the reason that gmail is not working. Chris Gotstein, Sr Network Engineer, UP Logon/Computer Connection UP http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com Harald Koch wrote: > It does appear that gmail going down leads to a DoS against the NANOG > list. :-) >
Re: Gmail Down?
It was short-lived, seems to be back up now, but a little flaky. Chris Gotstein, Sr Network Engineer, UP Logon/Computer Connection UP http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com Chris Gotstein wrote: > Anyone else seeing Google's Gmail down right now? Seems to have been > down since 10am CST. We are connected through Chicago. > downforeveryoneorjustme.com is also reporting it's down. >
Gmail Down?
Anyone else seeing Google's Gmail down right now? Seems to have been down since 10am CST. We are connected through Chicago. downforeveryoneorjustme.com is also reporting it's down. -- ---- Chris Gotstein, Sr Network Engineer, UP Logon/Computer Connection UP http://uplogon.com | +1 906 774 4847 | ch...@uplogon.com
Re: Qwest IPv6
Qwest is still beta testing IPv6. We turned ours up last week and were one of the first to do so. I can go through my notes and email you the contact info of the people that are working on that. Kevin Brown wrote: Does anyone have a contact at Qwest who can help us get the ball rolling to implement an exchange of IPv6 traffic? Their NOC referred us back to our account manager, who said "We don't do IPv6". A quick Google search would seem to indicate otherwise... Thanks! -- Chris Gotstein Sr Network Engineer UP Logon/Computer Connection UP 500 N Stephenson Ave Iron Mountain, MI 49801 Phone: 906-774-4847 Fax: 906-774-0335 ch...@uplogon.com
Re: IPv6 Addressing Help
I think we had to let ARIN know the time frame of deploying IPv6 and how many customers we expected to put on in the first couple years. They did not ask for an addressing scheme. Reading over the RFC's and other IPv6 resources, we have decided to hand out /56's to small/home/SOHO customers and /48's to larger customers. I'm just not able to wrap my brain around the subnetting that needs to be done on the router. Like i said before, i think i'm just over complicating it in my mind. Chris Gotstein Sr Network Engineer UP Logon/Computer Connection UP 500 N Stephenson Ave Iron Mountain, MI 49801 Phone: 906-774-4847 Fax: 906-774-0335 ch...@uplogon.com Thomas Mangin wrote: I do not know about arin but ripe changed it's policy so you only have to say "pretty please" to receive your allocation. It better that way anyway. Thomas Mangin On 14 Aug 2009, at 16:17, Jeroen Massar wrote: Chris Gotstein wrote: We are a small ISP that is in the process of setting up IPv6 on our network. We already have the ARIN allocation and i have a couple routers and servers running dual stack. Wondering if someone out there would be willing to give me a few pointers on setting up my addressing scheme? Strange, I recall that you had to submit one when requesting address space from ARIN. Why don't you use that one? I've been mulling over how to do it, and i think i'm making it more complicated than it needs to be. You can hit me offlist if you wish to help. Thanks. It all depends on your network and how you want to set it up, but for the sake of internal aggregation: * Determine the expected amount of IPv6 customers at a certain location for the next X years, making X > 2 (though 10 is probably a better idea, just in case, if don't want to do it again ;) ) * Take that number round it up to a power of 2 * Every customer gets a /48, you know the number, which is a power of 2, thus root it, and you know how many bits you need at that site eg expect 200 customers, round to power of 2 thus 256, which is 2^8, thus you will need a /48 + 8 bits = /40 at that location. You now know how much address space you need at that location for the next X years. Repeat that for all your locations / routing areas, basically the PoPs or termination points of your customers; or if you are really big do that per city/town/suburb. Keep enough space (the rounding helps there quite a bit, especially with numbers like 50k customers ;) Now you have an overview of what you expect to be allocating at each and every site. To add a little growth/future proof and to make live easy, you could either opt at this stage to round everything off to 'nice' numbers, eg only use /40's or /36's per PoP. Thus making everything the same, or doing things like grouping smaller PoPs together. Then when you have done that, take those blocks, and try to squeeze them a bit together. You should now have arrived to the address plan that you originally submitted to ARIN. Fill those blocks into a nice database, roll a PHP/shell/perl/whatever script to spit out your router configuration and presto: you are done. Enjoy the weekend ;) Greets, Jeroen
IPv6 Addressing Help
We are a small ISP that is in the process of setting up IPv6 on our network. We already have the ARIN allocation and i have a couple routers and servers running dual stack. Wondering if someone out there would be willing to give me a few pointers on setting up my addressing scheme? I've been mulling over how to do it, and i think i'm making it more complicated than it needs to be. You can hit me offlist if you wish to help. Thanks. -- Chris Gotstein Sr Network Engineer UP Logon/Computer Connection UP 500 N Stephenson Ave Iron Mountain, MI 49801 Phone: 906-774-4847 Fax: 906-774-0335 ch...@uplogon.com
Re: DOS in progress ?
check out: http://status.twitter.com/ Tells the story. Chris Gotstein Sr Network Engineer UP Logon/Computer Connection UP 500 N Stephenson Ave Iron Mountain, MI 49801 Phone: 906-774-4847 Fax: 906-774-0335 ch...@uplogon.com Ken Gilmour wrote: Down from Costa Rica and Ireland too... Interesting that they are starting to go for Social Networking sites now. Have they given up on online gambling sites now? It appears as though they haven't been actively attacking gambling sites for several days... 2009/8/6 Jorge Amodio : Are folks seeing any major DOS in progress ? Twitter seems to be under one and FB is flaky.
Re: DOS in progress ?
Seeing the same thing. Can't bring up either sites. Jorge Amodio wrote: Are folks seeing any major DOS in progress ? Twitter seems to be under one and FB is flaky.
Re: cisco.com
Seeing same issue from Chicago via Qwest and HE. > > Both work from Austin, TX. > > > > - d. > > On Tue, 4 Aug 2009, Alex Nderitu wrote: > >> Facebook seems to also be affected. >> >> >> -Original Message- >> From: R. Benjamin Kessler >> To: nanog@nanog.org >> Subject: cisco.com >> Date: Tue, 4 Aug 2009 09:34:46 -0400 >> >> >> Hey Gang - >> >> I'm unable to get to cisco.com from multiple places on the 'net >> (including downforeveryoneorjustme.com); any ideas on the cause and ETR? >> >> Thanks, >> >> Ben >> >> >> >> > > -- > Dominic J. Eidson > "Baruk Khazad! Khazad ai-menu!" - > Gimli > > http://www.dominiceidson.com/ > > -- Chris Gotstein Sr Network Engineer UP Logon/Computer Connection UP 500 N Stephenson Ave Iron Mountain, MI 49801 Phone: 906-774-4847 Fax: 906-774-0335 ch...@uplogon.com
