Re: [outages] Dyn outage continuing

On 10/21/16 13:52, Neal Lawson via Outages wrote: github is back now as well, however it looks like they switched to route53. I'm seeing almost all the domains I've been watching start to add other NS if they were exclusively using Dyn before. ~Seth _

Re: [outages] Dyn outage continuing

On Fri, Oct 21, 2016 at 01:52:10PM -0700, Neal Lawson via Outages wrote a message of 404 lines which said: > github is back now as well, however it looks like they switched to route53. The TTL of the NS record set was 86400 seconds so it will take some time before everyone see that change. __

Re: [outages] Dyn outage continuing

github is back now as well, however it looks like they switched to route53. > On Oct 21, 2016, at 1:50 PM, Josh Luthman via Outages > wrote: > > Twitter images (from Reddit links) weren't working before and are now. > Twitter home page loads. Netflix video starts now (wasn't before). > > >

Re: [outages] Dyn outage continuing

Twitter images (from Reddit links) weren't working before and are now. Twitter home page loads. Netflix video starts now (wasn't before). Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373 On Fri, Oct 21, 2016 at 4:43 PM, Lucky 225 wrote: > Seems li

Re: [outages] Dyn outage continuing

Yep. Looks like my email must have fixed it. J Best Regards, Ivan Kovacevic Vice President, Client Services Star Telecom | www.startelecom.ca

Re: [outages] Dyn outage continuing

Seems like everything's back up now as far as I can tell as of a few min ago On Fri, Oct 21, 2016 at 2:36 PM, Ivan Kovacevic via Outages < outages@outages.org> wrote: > The outage is still ongoing. But the horse has been flogged to death (and > then some). > > > > > > Best Regards, > > > > Ivan K

Re: [outages] Dyn outage continuing

The outage is still ongoing. But the horse has been flogged to death (and then some). Best Regards, Ivan Kovacevic Vice President, Client Services Star Telecom | www.startelecom.ca

Re: [outages] Dyn outage continuing

i’ll second that, all in favor? > On Oct 21, 2016, at 1:26 PM, Josh Luthman via Outages > wrote: > > Guys is this outage still going on? > > Can we move the discussion to -discussion, please... > > > Josh Luthman > Office: 937-552-2340 > Direct: 937-552-2343 > 1100 Wayne St > Suite 1337 > Tr

Re: [outages] Dyn outage continuing

Guys is this outage still going on? Can we move the discussion to -discussion, please... Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373 On Fri, Oct 21, 2016 at 4:23 PM, Peter Beckman via Outages < outages@outages.org> wrote: > On Fri, 21 Oct 2016

Re: [outages] Dyn outage continuing

On Fri, 21 Oct 2016, Jim Popovitch via Outages wrote: On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages wrote: Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service. Which part of Dyn? IIRC, ther

Re: [outages] Dyn outage continuing

- Original Message - > From: "Dj Padzensky via Outages" > Interesting though it may be, it's probably a topic better pursued on > outages-discussion. My understanding is that outages is really supposed to be > limited to what's down, according to whom, impact, ETR, etc. > > Can we get a

Re: [outages] Dyn outage continuing

There is a secondary outage that is still ongoing. Look on dynstatus.com for the latest updates. On Oct 21, 2016 3:16 PM, "jungle Boogie via Outages" wrote: > On 21 October 2016 at 09:12, Terry Hardie via Outages > wrote: > > Even though their page says the outage is resolved, I'm still getting

Re: [outages] Dyn outage continuing

Changing from fire suite to admin hat after this morning's event due to hosted services going dark. My salute to Dyn team, we all know this is a thankless job for the folks on the frontline. Anyway yes that's correct, typically conversation does shift to outages-discussion not much direction

Re: [outages] Dyn outage continuing

On 21 October 2016 at 09:12, Terry Hardie via Outages wrote: > Even though their page says the outage is resolved, I'm still getting > DNS failures (return SERVFAIL, not no answer) to their anycast > networks from California: I can't reach github.com from Cox in Las Vegas but at work I can. ;;

Re: [outages] Dyn outage continuing

Interesting though it may be, it's probably a topic better pursued on outages-discussion. My understanding is that outages is really supposed to be limited to what's down, according to whom, impact, ETR, etc. Can we get a mod to weigh in? --Dj Sent from my iPhone > On Oct 21, 2016, at 11:52

Re: [outages] Dyn outage continuing

To be honest, this discussion should be on outages-discuss...@outages.org, not the main outages list for reporting... But that doesn't really matter now. On Oct 21, 2016 2:53 PM, "Russell Zen via Outages" wrote: > IMO it's important to factor in the business aspect into our IT work in > networki

Re: [outages] Dyn outage continuing

This is a list for OUTAGE NOTIFICATIONS ONLY. Even my message is noise not signal, but I'm hoping it helps. Many of us get this via text and just need to know what's on fire. There's outages-discuss and other places to talk. THIS IS FOR NOTIFICATIONS ONLY. On Fri, Oct 21, 2016 at 11:52 AM, Ru

Re: [outages] Dyn outage continuing

IMO it's important to factor in the business aspect into our IT work in networking. Then again I came from accounting before IT so I sort of see things in scope of dollars anyway. I appreciate the dialogue. Get Outlook for Android On Fri, Oct 21, 2016 at 11:39 AM -0700,

Re: [outages] Dyn outage continuing

Weird... I thought I was subscribed to a mailing list about outages, not pricing debates and pee contests.I'll have to evaluate my account settings. On Fri, Oct 21, 2016 at 11:35 AM, Mike Lieman via Outages < outages@outages.org> wrote: > The strangest thing was that while our premium Man

Re: [outages] Dyn outage continuing

Just guessing here, but I'm assuming the $40 plans don't utilize Dyn's anycast infrastructure, which is apparently the target of this attack? Literally just a guess, though. On Fri, Oct 21, 2016 at 2:36 PM Mike Lieman via Outages wrote: > The strangest thing was that while our premium Managed D

Re: [outages] Dyn outage continuing

They run on different DNS servers. One was targeted, one wasn’t. The perpetrators clearly wanted to impact the most damage on commercial services, who are the ones who can afford Managed DNS services, so they picked those to target. Thus, your cheap services weren’t impacted because they weren’t

Re: [outages] Dyn outage continuing

The strangest thing was that while our premium Managed DNS ( Dynect ) domains were having issues, the 40 dollar ones I use for my own personal stuff were rock solid. Guess that layer isn't high profile enough or something? On Fri, Oct 21, 2016 at 2:14 PM, Jim Popovitch via Outages < outages@ou

Re: [outages] Dyn outage continuing

A buddy of mine just forwarded this story my way. It gives some insight as to what may have triggered the events. https://krebsonsecurity.com/2016/10/ddos-on-dyn-impacts-twitter-spotify-reddit/ -Original Message- From: Outages [mailto:outages-boun...@outages.org] On Behalf Of Andrew S

Re: [outages] Dyn outage continuing

Google has a completely different revenue stream than Dyn, not sure that's a valid argument. Dominick Colangelo * Systems Administrator * Technology Services * wit.edu/dts * Follow us on Twitter @ DTSatWIT -Original Message- From: Outages [mailto:outages-boun...@outages.org] On Behalf

Re: [outages] Dyn outage continuing

>That's not saying that Dyn is bad, but some people like to tout them as the >end-all-be-all at $40/yr so as with anything you get what you pay for. How much do you pay a yr for www.google.com, yet that is fairly robust. So as with anything you don't always get what you pay for. This elect

Re: [outages] Dyn outage continuing

Dear colleagues, On Fri, Oct 21, 2016 at 02:14:34PM -0400, Jim Popovitch via Outages wrote: > On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages > wrote: > > Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on > > the planet. Possibly the largest that sells DNS

Re: [outages] Dyn outage continuing

On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages wrote: > Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on > the planet. Possibly the largest that sells DNS as a service. Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't

Re: [outages] Outages Digest, Vol 101, Issue 51

Outages mailing list > Outages@outages.org > https://puck.nether.net/mailman/listinfo/outages > > > -- > > KAYAK > > Neil Hanlon > > Devops Engineer > > > +1 978 902 8171 > > ___ > Outages mailing list > Out

Re: [outages] Dyn outage continuing

Trump sponsored internet outage.. — Best regards, Michael Self This email composed on my iPhone 8 while driving with my knees. Please excuse brevity and typos due to Siri's hearing problems, accidents, cops or other mishaps. On Oct 21, 2016, at 13:53, Kun, Mike via Outages mail

Re: [outages] Dyn outage continuing

Does anyone have volume or attack information? What sort of attack(s) are suspected? -Mike Kun > On Oct 21, 2016, at 1:40 PM, Sajal Kayan via Outages > wrote: > > It appears most of the world cant reach Dyn : > https://pulse.turbobytes.com/results/580a5178ecbe402e2201a74c/ >

Re: [outages] Dyn outage continuing

It appears most of the world cant reach Dyn : https://pulse.turbobytes.com/results/580a5178ecbe402e2201a74c/ But for the most part, its resolving thru Google DNS/OpenDNS : https://pulse.turbobytes.com/results/580a51ceecbe402e2201a74e/ On Sat, Oct 22, 2016 at 12:31 AM Andrew Bunde via Outages < ou

Re: [outages] Dyn outage continuing

What are you basing your claims on? On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages wrote: > It is a shame in that PagerDuty is affected. > > However, Dyn is far, far better positioned to withstand attacks than a > company like PagerDuty could possibly be on their own. So I think

Re: [outages] Dyn outage continuing

Don’t forget https://bit.namecoin.info/ From: Outages [mailto:outages-boun...@outages.org] On Behalf Of Jason Antman via Outages Sent: Friday, October 21, 2016 1:25 PM Cc: outages@outages.org Subject: Re: [outages] Dyn outage continuing This is just a horribly painful example of why we/they sho

Re: [outages] Dyn outage continuing

This is just a horribly painful example of why we/they should all follow the route of NetFlix ( http://techblog.netflix.com/2013/05/denominating-multi-region-sites.html ) and use multiple DNS providers. Denominator ( https://github.com/Netflix/denominator ) the tool NetFlix uses for this and open-s

Re: [outages] Dyn outage continuing

We had issues resolving www.paypal.com via Comcast coming from NW sub-burb of Chicago from ~7:26a-8:11a (CT). Worked via another ISP. Issue started again for us. -Original Message- From: Outages [mailto:outages-boun...@outages.org] On Behalf Of Terry Hardie via Outages Sent: Friday,

Re: [outages] Dyn outage continuing

It is a shame in that PagerDuty is affected. However, Dyn is far, far better positioned to withstand attacks than a company like PagerDuty could possibly be on their own. So I think PagerDuty did the right thing in using Dyn. Remember, Twitter, Pingdom, github, and lots of other people use Dyn.

Re: [outages] Dyn outage continuing

It's a shame services like PagerDuty use Dyn. Now they're down too... On Fri, Oct 21, 2016 at 9:57 AM, Justin Krejci via Outages wrote: > Previously it was not affecting upper midwest for me, traces went to > Chicago. > > Now traces to twitter DNS servers in Chicago are failing. > > > ___

Re: [outages] Dyn outage continuing

Previously it was not affecting upper midwest for me, traces went to Chicago. Now traces to twitter DNS servers in Chicago are failing. From: Neil Hanlon via Outages [outages@outages.org] Sent: Friday, October 21, 2016 11:16 AM To: Terry Hardie; outages@outages.o

Re: [outages] Major DNS DoS

Dyn reporting another attack started at 15:52 UTC. ___ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Re: [outages] Dyn outage continuing

The attacks appear to be continuing again. We are experiencing issues in Europe/Asia. On Fri, Oct 21, 2016 at 12:13 PM Terry Hardie via Outages < outages@outages.org> wrote: Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to thei

Re: [outages] Dyn outage continuing

Seems more widespread and affecting the backend of Dyn. The fact that I get SERVFAIL sometimes means their DNS answered - Just couldn't give me THE answer :) I've tested it from Ashburn, VA, Miami, FL, New York, NY and Chicao, IL. Chicago is the only one that worked. On Fri, Oct 21, 2016 at 9:13

Re: [outages] Dyn outage continuing

On 10/21/16 09:12, Terry Hardie via Outages wrote: Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California: I was able to access Twitter this morning and now it's dead. I'm west coast. twitte

Re: [outages] Dyn outage continuing

Attack just re-started. Watch your flows. Help out if you can. -- TTFN, patrick > On Oct 21, 2016, at 12:12 PM, Terry Hardie via Outages > wrote: > > Even though their page says the outage is resolved, I'm still getting > DNS failures (return SERVFAIL, not no answer) to their anycast > netwo

[outages] Dyn outage continuing

Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California: $ dig @ns2.p34.dynect.net video.twimg.com ; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net video.twimg.com ; (1 server found) ;; global options:

Re: [outages] Major DNS DoS

On Fri, Oct 21, 2016 at 09:10:41AM -0400, Adam Greene via Outages wrote a message of 104 lines which said: > I'm probably not noticing this being reported on this list, because of the > very DNS issues taking place, but just in case: Seems OK now? https://www.dynstatus.com/incidents/nlr4yrr1

Re: [outages] Major DNS DoS

I was definitely seeing it this morning, had a few customers unable to reach a certain vendor due to DNS not responding and my own Reddit browsing was unreliable, but it cleared up and has been solid since a bit after 9:00 Eastern. Dyn status page says they consider the problem resolved as of 9:20

Re: [outages] Major DNS DoS

So far, we’re not seeing any issues in NE TN, SW VA, Western KY, or middle GA. Thanks! -- Rob Hall, CCNP R&S, CCP-V I.T. Manager @Work Personnel Service 3815 Hwy 66 S, Suite 4 Rogersville, TN 37857 Office: (423)272-7897, x10113 Mobile: (423)312-6003 [cisco-certified-ccnp][CCP-V] From: Outages

Re: [outages] Dynect.net - DNS Trouble from Comcast Business Michigan?

There's a large-scale DDoS attack happening against Dyn's name servers, news about it is also on the NANOG list: http://gizmodo.com/this-is-probably-why-half-the-internet-shut-down-today-1788062835 https://www.dynstatus.com/incidents/nlr4yrr162t8 Matt Freitag Network Engineer I Information Techno

Re: [outages] Major DNS DoS

Sorry, should have provided more info last time. Same behavior seen up to Boston. Some of our internal health checks actually picked it up around 7:30AM EDT Dominick Colangelo * Systems Administrator * Technology Services * wit.edu/dts * Follow us on Twitter @ DTSatWIT<

Re: [outages] Major DNS DoS

Saw it here too. Western PA intermittent and verified with various public dns servers. Chuck On Fri, Oct 21, 2016 at 9:11 AM, Colangelo, Dom via Outages < outages@outages.org> wrote: > I prefer my updates from the affected company themselves than gizmodo J > > > > https://www.dynstatus.com/in

Re: [outages] Dynect.net - DNS Trouble from Comcast Business Michigan?

On Fri, Oct 21, 2016 at 09:11:34AM -0400, Mike Phipps via Outages wrote a message of 175 lines which said: > issues with sites that use DYNECT.NET for serving their DNS https://www.dynstatus.com/incidents/nlr4yrr162t8 DDoS Attack Against Dyn Managed DNS Incident Report for Dyn, Inc. Subscri

Re: [outages] Dynect.net - DNS Trouble from Comcast Business Michigan?

Probably related to this: https://www.dynstatus.com/incidents/nlr4yrr162t8 On Fri, Oct 21, 2016 at 7:11 AM, Mike Phipps via Outages < outages@outages.org> wrote: > Is anyone else who is on Comcast Business Class in the Detroit, MI area > having issues with sites that use DYNECT.NET for serving t

Re: [outages] Major DNS DoS

I just noticed some DNS non-responsiveness from Level 3's DNS servers that are anycast from the Midwest area. Google appeared fine in contrast. It has since returned to normal. -- B.J. From: Outages [mailto:outages-boun...@outages.org] On Behalf Of Adam Greene via Outages Sent: Friday, Oct

Re: [outages] Major DNS DoS

I prefer my updates from the affected company themselves than gizmodo :) https://www.dynstatus.com/incidents/nlr4yrr162t8 Dominick Colangelo * Systems Administrator * Technology Services * wit.edu/dts * Follow us on Twitter @ DTSatWIT From:

[outages] Dynect.net - DNS Trouble from Comcast Business Michigan?

Is anyone else who is on Comcast Business Class in the Detroit, MI area having issues with sites that use DYNECT.NET for serving their DNS zone files? I found that I could not reach any name server at DYNECT.NET, so it was causing sites like wikia.com, theverge.com, theguardian.com, &c to fail for

[outages] Major DNS DoS

I'm probably not noticing this being reported on this list, because of the very DNS issues taking place, but just in case: http://gizmodo.com/this-is-probably-why-half-the-internet-shut-down-today-17 88062835 Adam ___ Outages mailing list Outages