Re: Level 3 issues?

2016-05-17 Thread Tom Beecher via NANOG
Was looking at an internal report not long ago. L3 NYC to Miami looked to be in really rough shape. As I was watching, things flipped inside L3 to go NYC->Boston, then handed off to Cogent.  Didn't dig further than that, but methinks they have something going on, yes.   Thanks, Beecher On

Re: Level 3 issues?

2016-05-16 Thread George Herbert
Yes; you should subscribe to outa...@outages.org for better reports. (Short summary - yes, no root cause/TTR yet). George William Herbert Sent from my iPhone > On May 16, 2016, at 12:49 PM, David Hubbard > wrote: > > Anyone seeing issues with Level 3 networking right now? We’re seeing huge

Re: Level 3 issues?

2016-05-16 Thread Nick Olsen
x106 From: "David Hubbard" Sent: Monday, May 16, 2016 4:18 PM To: "nanog@nanog.org" Subject: Re: Level 3 issues? I just heard from someone there is suspicion that a fiber cut occurred in FL, possibly Miami area, and it has revealed a capacity issue on

Re: Level 3 issues?

2016-05-16 Thread David Hubbard
I just heard from someone there is suspicion that a fiber cut occurred in FL, possibly Miami area, and it has revealed a capacity issue on the L3 network. Haven’t received official word on that yet, but I know our legacy TWTC connection is nearly as useless as our L3 connection thanks to the ne

Re: Level 3 issues?

2016-05-16 Thread Jordan Medlen
Have been seeing issues since just after 3P. Had to swing my traffic over to another provider. Level3 says issues seen from Costa Rica on up to WDC. Thank you, Jordan Medlen Enterprise Communications Manager Bisk Education (813) 612-6207 On 5/16/16, 3:49 PM, "NANOG on

RE: Level 3 issues?

2016-05-16 Thread Ray Orsini
3:49 PM To: nanog@nanog.org Subject: Level 3 issues? Anyone seeing issues with Level 3 networking right now? We’re seeing huge latency and loss on traffic coming inbound (to us, AS33260) but it seems to be at the peering points with other major ISP’s and Level 3. Comcast for example: 3

Level 3 issues?

2016-05-16 Thread David Hubbard
Anyone seeing issues with Level 3 networking right now? We’re seeing huge latency and loss on traffic coming inbound (to us, AS33260) but it seems to be at the peering points with other major ISP’s and Level 3. Comcast for example: 333 ms21 ms70 ms te-3-5-ur01.hershey.pa.pitt.co

Level 3 issues in Chicago

2015-10-30 Thread Randy Carpenter
A network that we manage is having trouble getting to several sites. The common point of failure appears to be Level 3 in Chicago. Connections work fine from our direct upstream, so it appears that Level 3 is not allowing traffic sourced from the net block in question. Can someone from Level 3

Re: Level 3 issues in Miami/West Palm Beach

2015-01-13 Thread Blair Trosper
In this case, it appeared to be a customer's edge router, not a core/backbone router...although those did seem to have rather high latency (400ms and higher in some cases) and high packet loss (about 18-20%). On Tue, Jan 13, 2015 at 7:54 PM, Stephen Satchell wrote: > On 01/13/2015 03:18 PM, vald

Re: Level 3 issues in Miami/West Palm Beach

2015-01-13 Thread Stephen Satchell
On 01/13/2015 03:18 PM, valdis.kletni...@vt.edu wrote: > On Tue, 13 Jan 2015 16:52:49 -0600, Blair Trosper said: >> All packets traveling through customer edges and routers in Miami/Daytona >> seem to be incurring *extraordinary* latency (4+ seconds) all of a sudden. > > I'm impressed that the rou

Re: Level 3 issues in Miami/West Palm Beach

2015-01-13 Thread Valdis . Kletnieks
On Tue, 13 Jan 2015 16:52:49 -0600, Blair Trosper said: > All packets traveling through customer edges and routers in Miami/Daytona > seem to be incurring *extraordinary* latency (4+ seconds) all of a sudden. I'm impressed that the routers have sufficient buffer memory to do that. pgpkLc4IsDD58.

Level 3 issues in Miami/West Palm Beach

2015-01-13 Thread Blair Trosper
All packets traveling through customer edges and routers in Miami/Daytona seem to be incurring *extraordinary* latency (4+ seconds) all of a sudden. Can someone contact me off list so I can throw you some traceroutes?

RE: level3 issue in chicago (was: FYI, Level 3 issues in Dallas)

2014-11-19 Thread David Hubbard
of Dallas. David -Original Message- From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Cool Hand Luke Sent: Wednesday, November 19, 2014 11:23 AM To: nanog@nanog.org Subject: Re: level3 issue in chicago (was: FYI, Level 3 issues in Dallas) like david below, we've been getti

Re: level3 issue in chicago (was: FYI, Level 3 issues in Dallas)

2014-11-19 Thread Cool Hand Luke
like david below, we've been getting reports this morning from customers unable to reach various web sites. investigating a number of these reports, the one commonality is level3 in chicago. sites are reachable from level3/cincinnati but not level3/chicago. traceroutes make it one hop past o

Re: FYI, Level 3 issues in Dallas

2014-11-19 Thread garya
Also peering problems in Chicago, had to drop BGP to them until they figure it out. Reported it 4 hours ago, no good response yet. Gary > We have some customers unable to access their websites, seeing this on > the way to them: > > 4 ae-0-11.bar2.Tampa1.Level3.net (4.69.137.110) 0.343 ms 0.42

Re: FYI, Level 3 issues in Dallas

2014-11-19 Thread Jeroen Massar
On 2014-11-19 16:13, David Hubbard wrote: > We have some customers unable to access their websites, seeing this on > the way to them: What would be the source and destination? You got a nice routing loop there. Greets, Jeroen

FYI, Level 3 issues in Dallas

2014-11-19 Thread David Hubbard
We have some customers unable to access their websites, seeing this on the way to them: 4 ae-0-11.bar2.Tampa1.Level3.net (4.69.137.110) 0.343 ms 0.423 ms 0.406 ms 5 ae-12-12.ebr1.Dallas1.Level3.net (4.69.137.118) 23.940 ms 23.470 ms 23.426 ms 6 ae-71-71.csw2.Dallas1.Level3.net (4.69.151

level 3 issues this morning

2010-04-24 Thread Welch, Bryan
FYI There is some routing flakiness going on with Level 3 this morning, which L3 confirms. Some routes sent to their network are dying, some not. We are having reach ability issues over them on the west coast. Bypassing level 3 for the moment. Bryan

Re: Level 3 issues

2008-12-29 Thread Gary E. Miller
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Yo Matt! On Mon, 29 Dec 2008, Matthew Petach wrote: > Yes. A nice set of examples of why that anger exists > can be found here: > http://news.search.yahoo.com/news/search?p=petach+kablooie Well... I sorta liked that story. I did not think you came

Re: Level 3 issues

2008-12-29 Thread Matthew Petach
On 12/29/08, marco wrote: > I think that most of the anger was directed at the wanna-be > reporters/journalists that visit this list. Yes. A nice set of examples of why that anger exists can be found here: http://news.search.yahoo.com/news/search?p=petach+kablooie :( Matt > Todd Vierling w

RE: Level 3 issues

2008-12-29 Thread Murphy, Jay, DOH
r 29, 2008 11:20 AM To: nanog@nanog.org Subject: Re: Level 3 issues I think that most of the anger was directed at the wanna-be reporters/journalists that visit this list. Todd Vierling wrote: > On Mon, Dec 29, 2008 at 11:33 AM, Murphy, Jay, DOH > wrote: > >> You know, it gets

Re: Level 3 issues

2008-12-29 Thread marco
I think that most of the anger was directed at the wanna-be reporters/journalists that visit this list. Todd Vierling wrote: > On Mon, Dec 29, 2008 at 11:33 AM, Murphy, Jay, DOH > wrote: > >> You know, it gets pretty thick through here, when all you people slam on >> someone, to justify pent

Re: Level 3 issues

2008-12-29 Thread Todd Vierling
On Mon, Dec 29, 2008 at 11:33 AM, Murphy, Jay, DOH wrote: > You know, it gets pretty thick through here, when all you people slam on > someone, to justify pent up angst or whatever the cause may be. I > worked for Level 3 as a NOC engr, and they follow standards as other > companies do, and for t

RE: Level 3 issues

2008-12-29 Thread Murphy, Jay, DOH
ecember 28, 2008 12:22 PM Cc: nanog@nanog.org Subject: Re: Level 3 issues marco wrote: >>From what I heard, it was some some malfunction with a router in > Washington D.C. which terminated a 100GB bundle from Paris. It was > carring about 50GB at the time of the failure. > > Not s

RE: Level 3 issues

2008-12-29 Thread Murphy, Jay, DOH
y.com] Sent: Sunday, December 28, 2008 3:18 PM To: Alex H. Ryu Cc: nanog@nanog.org Subject: RE: Level 3 issues I have heard this story several times. The train derailment was yesterday in New York unless it has not made it to news.google.com on a search for train derail. Issues did not start until

Re: Level 3 issues

2008-12-29 Thread Rich Kulawiec
On Sun, Dec 28, 2008 at 11:21:50AM -0800, Matthew Petach wrote: > Given the lurking presence of wannabe press vultures here, I > doubt you'll see anything forthcoming from the technical folks > about what actually happened. This is not to say that people > haven't been informed of the issue, it's

Re: Level 3 issues

2008-12-28 Thread Justin M. Streiner
On Sun, 28 Dec 2008, Jim Popovitch wrote: On Sun, Dec 28, 2008 at 17:17, Blake Pfankuch wrote: It seems highly unlikely that a train derailment yesterday caused major network issues today. Have you ever seen cleanup efforts after a major accident. Cleanup usually involves more backhoes, a

Re: Level 3 issues

2008-12-28 Thread Jim Popovitch
On Sun, Dec 28, 2008 at 17:17, Blake Pfankuch wrote: > It seems highly unlikely that a train derailment yesterday caused major > network issues today. Have you ever seen cleanup efforts after a major accident. Cleanup usually involves more backhoes, and other major equipment, than a normal wel

RE: Level 3 issues

2008-12-28 Thread Blake Pfankuch
. -Original Message- From: Alex H. Ryu [mailto:r.hyuns...@ieee.org] Sent: Sunday, December 28, 2008 2:44 PM To: Blake Pfankuch Cc: Derek Bodner; nanog@nanog.org Subject: Re: Level 3 issues It seems that there was fiber cut because of train derailment around NY area. Alex Blake Pfankuch

Re: Level 3 issues

2008-12-28 Thread Alex H. Ryu
nkuch > Cc: Jon Wolberg; Jason Cheslock; nanog@nanog.org > Subject: Re: Level 3 issues > > Looks like most providers here in the east coast are routing through level3 > again, and I'm not seeing any packet loss or latency anymore. > On Sun, Dec 28, 2008 at 1:47 PM, Blake Pfan

Re: Level 3 issues

2008-12-28 Thread virendra rode
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 IMHO, this is exactly what service providers love to hear in order for them not to be forth coming. regards, /virendra Matthew Petach wrote: > On 12/28/08, Blake Pfankuch wrote: >> Any word on the actual cause of the issue? > > Given the lurking

Re: Level 3 issues

2008-12-28 Thread marco
Steven King wrote: > We saw our bandwidth drop on our Level3 OC-48 to about half of what we > were doing. We had to stop announcing our subnets to Level3 to get > traffic to fail over properly throughout the world. We have a ticket > open with Level3's NOC but have not received word on what happene

Re: Level 3 issues

2008-12-28 Thread Steven King
We saw our bandwidth drop on our Level3 OC-48 to about half of what we were doing. We had to stop announcing our subnets to Level3 to get traffic to fail over properly throughout the world. We have a ticket open with Level3's NOC but have not received word on what happened or when to expect a resol

Re: Level 3 issues

2008-12-28 Thread Kevin Loch
marco wrote: From what I heard, it was some some malfunction with a router in Washington D.C. which terminated a 100GB bundle from Paris. It was carring about 50GB at the time of the failure. Not sure why routes within the US would be effected. We connect to level3 in Ashburn/DC and saw traf

Re: Level 3 issues

2008-12-28 Thread Matthew Petach
On 12/28/08, Blake Pfankuch wrote: > Any word on the actual cause of the issue? Given the lurking presence of wannabe press vultures here, I doubt you'll see anything forthcoming from the technical folks about what actually happened. This is not to say that people haven't been informed of the is

Re: Level 3 issues

2008-12-28 Thread marco
Blake Pfankuch wrote: > Any word on the actual cause of the issue? > > From: Derek Bodner [mailto:subscribedli...@derekbodner.com] > Sent: Sunday, December 28, 2008 11:53 AM > To: Blake Pfankuch > Cc: Jon Wolberg; Jason Cheslock; nanog@nanog.org > Subject: Re: Level 3 issue

RE: Level 3 issues

2008-12-28 Thread Blake Pfankuch
Any word on the actual cause of the issue? From: Derek Bodner [mailto:subscribedli...@derekbodner.com] Sent: Sunday, December 28, 2008 11:53 AM To: Blake Pfankuch Cc: Jon Wolberg; Jason Cheslock; nanog@nanog.org Subject: Re: Level 3 issues Looks like most providers here in the east coast are

Re: Level 3 issues

2008-12-28 Thread Derek Bodner
loss to NY. > > -Original Message- > From: Jon Wolberg [mailto:j...@defenderhosting.com] > Sent: Sunday, December 28, 2008 11:40 AM > To: Jason Cheslock > Cc: nanog@nanog.org > Subject: Re: Level 3 issues > > Confirmed here as well. > > > Jon > > &

RE: Level 3 issues

2008-12-28 Thread Blake Pfankuch
Seems to be normalizing here in Colorado as well, however still having occasional packet loss to NY. -Original Message- From: Jon Wolberg [mailto:j...@defenderhosting.com] Sent: Sunday, December 28, 2008 11:40 AM To: Jason Cheslock Cc: nanog@nanog.org Subject: Re: Level 3 issues

Re: Level 3 issues

2008-12-28 Thread Jon Wolberg
Confirmed here as well. Jon - Original Message - From: "Jason Cheslock" To: "marco" Cc: nanog@nanog.org Sent: Sunday, December 28, 2008 1:35:45 PM GMT -05:00 US/Canada Eastern Subject: Re: Level 3 issues According to L3, this issue should be fixed and we should

Re: Level 3 issues

2008-12-28 Thread Johan Denoyer
gt; happening here too... > >> > >> Shutting down their session until something looks "better" > >> > >> -Original Message- > >> From: Pierre-Henri [mailto:phac...@gmail.com] Sent: December 28, 2008 > >> 1:06 PM > >> To:

Re: Level 3 issues

2008-12-28 Thread Jason Cheslock
According to L3, this issue should be fixed and we should start seeing > the traffic normalizing. > Can anyone confirm? Here in Richmond Virginia, everything seems to be back to normal now. Traffic coming from my Comcast connection can get through L3 now. 7 11 ms 13 ms 11 ms te-0-3-0-0-cr01.

Re: Level 3 issues

2008-12-28 Thread marco
iginal poster sent the first message... it's now >> happening here too... >> >> Shutting down their session until something looks "better" >> >> -Original Message- >> From: Pierre-Henri [mailto:phac...@gmail.com] Sent: December 28, 2008

Re: Level 3 issues

2008-12-28 Thread Thomas Beecher
I'm showing significant latency and loss over my L3 stuff. interetpulse.net showing the same thing too, seems to be a substantial problem. Pierre-Henri wrote: marco a écrit : is anyone having issues with Level3? hi, theplanet.com and many websites (cnn.com ; amazon.com ; ... ) have not

Re: Level 3 issues

2008-12-28 Thread marco
From: Pierre-Henri [mailto:phac...@gmail.com] > Sent: Sunday, December 28, 2008 11:06 AM > To: marco > Cc: nanog@nanog.org > Subject: Re: Level 3 issues > > marco a écrit : > >> is anyone having issues with Level3? >> >> >> > hi, > theplane

Re: Level 3 issues

2008-12-28 Thread Paul
...@gmail.com] Sent: December 28, 2008 1:06 PM To: marco Cc: nanog@nanog.org Subject: Re: Level 3 issues marco a écrit : is anyone having issues with Level3? hi, theplanet.com and many websites (cnn.com ; amazon.com ; ... ) have not been accessible from France (Orange, home connection)

RE: Level 3 issues

2008-12-28 Thread Blake Pfankuch
: Sunday, December 28, 2008 11:06 AM To: marco Cc: nanog@nanog.org Subject: Re: Level 3 issues marco a écrit : > is anyone having issues with Level3? > > hi, theplanet.com and many websites (cnn.com ; amazon.com ; ... ) have not been accessible from France (Orange, home connection) for about 3

RE: Level 3 issues

2008-12-28 Thread Paul Stewart
c...@gmail.com] Sent: December 28, 2008 1:06 PM To: marco Cc: nanog@nanog.org Subject: Re: Level 3 issues marco a écrit : > is anyone having issues with Level3? > > hi, theplanet.com and many websites (cnn.com ; amazon.com ; ... ) have not been accessible from France (Orange, home connection

Re: Level 3 issues

2008-12-28 Thread Pierre-Henri
marco a écrit : is anyone having issues with Level3? hi, theplanet.com and many websites (cnn.com ; amazon.com ; ... ) have not been accessible from France (Orange, home connection) for about 30 minutes. Don't know if there is a link with your question, but it's strange... Pierre-Henri

Re: Level 3 issues

2008-12-28 Thread Pierre-Henri
marco a écrit : is anyone having issues with Level3? hi, theplanet.com and many websites (cnn.com ; amazon.com ; ... ) have not been accessible from France (Orange, home connection) for about 30 minutes. Don't know if there is a link with your question, but . Pierre-Henri

Re: Level 3 issues

2008-12-28 Thread marco
jajog...@gmail.com wrote: > Yes sir. > > >> -Original Message- >> From: marco [mailto:ma...@zero11.com] >> Sent: Sunday, December 28, 2008 12:59 PM >> To: nanog@nanog.org >> Subject: Level 3 issues >> >> is anyone having issues with Level3? >> > > do you have any more details?

Re: Level 3 issues

2008-12-28 Thread Matt Kelly
Yes. We just experienced an outage in Philadelphia. We shut down the circuit pending further investigation. On Dec 28, 2008, at 12:58 PM, marco wrote: is anyone having issues with Level3?

Re: Level 3 issues

2008-12-28 Thread David Coulson
http://www.internetpulse.net/ (if you can get to it). Does not look pretty for L3. I can't get to most web sites if I go via Level3 (Cleveland, OH). Ping/traceroute look good though. marco wrote: is anyone having issues with Level3?

RE: Level 3 issues

2008-12-28 Thread Paul Stewart
What country, location, where you fed from?? -Original Message- From: marco [mailto:ma...@zero11.com] Sent: December 28, 2008 12:59 PM To: nanog@nanog.org Subject: Level 3 issues is anyone having issues with Level3

Level 3 issues

2008-12-28 Thread marco
is anyone having issues with Level3?

RE: Level(3) Issues

2008-09-19 Thread Robert D. Scott
Gainesville, FL 32611 321-663-0421 Cell -Original Message- From: Paul Stewart [mailto:[EMAIL PROTECTED] Sent: Friday, September 19, 2008 9:17 AM To: James Baldwin; nanog@nanog.org Subject: RE: Level(3) Issues Can you post a couple of IP's ? We're out of Level(3) Detroi

RE: Level(3) Issues

2008-09-19 Thread Paul Stewart
Can you post a couple of IP's ? We're out of Level(3) Detroit node and don't see anything towards Disney.com etc Paul -Original Message- From: James Baldwin [mailto:[EMAIL PROTECTED] Sent: Friday, September 19, 2008 8:01 AM To: nanog@nanog.org Subject: Level(3) Is

Level(3) Issues

2008-09-19 Thread James Baldwin
Is anyone else experiencing increased latency or packet loss through the Level3/Broadwing network? I have seen sporadic packet loss to several locations nationally over the last several hours.