Send Outages-discussion mailing list submissions to outages-discussion@outages.org
To subscribe or unsubscribe via the World Wide Web, visit https://puck.nether.net/mailman/listinfo/outages-discussion or, via email, send a message with subject or body 'help' to outages-discussion-requ...@outages.org You can reach the person managing the list at outages-discussion-ow...@outages.org When replying, please edit your Subject line so it is more specific than "Re: Contents of Outages-discussion digest..." Today's Topics: 1. Re: [outages] Facebook Down (Chad Austin) 2. On the subject of root cause analyses and postmortems... (Chapman, Brad (NBCUniversal)) ---------------------------------------------------------------------- Message: 1 Date: Mon, 4 Oct 2021 23:04:32 -0400 From: Chad Austin <m...@chadaustin.org> To: outages-discussion@outages.org Subject: Re: [Outages-discussion] [outages] Facebook Down Message-ID: <411a5e22-c577-9b44-9f28-9d9495866...@chadaustin.org> Content-Type: text/plain; charset="utf-8"; Format="flowed" When the emails take hours to arrive, everyone gets to be first. On 10/4/2021 5:47 PM, Nate wrote: > Wonder how many more people are going to say it's down for them, in a > certain state or country without reading this email chain? > > To everyone who DOESNT READ the chain. > YES!!! Facebook, IG,Messenger,? and WhatsApp are down hard, meaning no > one can access any of those services in any state or country currently. > > > On Mon, Oct 4, 2021, 3:39 PM Rusty Dekema <rdek...@gmail.com > <mailto:rdek...@gmail.com>> wrote: > > Facebook is having DNS issues probably stemming from a network > engineering issue: > > > facebook.com <http://facebook.com>. > Server:? dns.google > Address:? 2001:4860:4860::8888 > *** dns.google can't find facebook.com <http://facebook.com>.: > Server failed > > > facebook.com <http://facebook.com>. > Server: dns9.quad9.net <http://dns9.quad9.net> > Address:? 9.9.9.9 > *** dns9.quad9.net <http://dns9.quad9.net> can't find facebook.com > <http://facebook.com>.: Server failed > > https://twitter.com/Benjojo12/status/1445054959209287680 > <https://twitter.com/Benjojo12/status/1445054959209287680> > > Facebook owns Instagram and WhatsApp, so this is probably responsible > for those services' outages as well. > > -Rusty > > On Mon, Oct 4, 2021 at 12:08 PM Matt Hoppes via Outages > <outa...@outages.org <mailto:outa...@outages.org>> wrote: > > > > Is anyone else seeing Facebook down?? ?Seems to be offline here in > > Pennsylvania.. started with error messages now DNS errors. > > > > Seeing lots of errors on Instagram, QuickBooks, Whatsapp, Amazon. > > _______________________________________________ > > Outages mailing list > > outa...@outages.org <mailto:outa...@outages.org> > > https://puck.nether.net/mailman/listinfo/outages > <https://puck.nether.net/mailman/listinfo/outages> > _______________________________________________ > Outages-discussion mailing list > Outages-discussion@outages.org <mailto:Outages-discussion@outages.org> > https://puck.nether.net/mailman/listinfo/outages-discussion > <https://puck.nether.net/mailman/listinfo/outages-discussion> > > > _______________________________________________ > Outages-discussion mailing list > Outages-discussion@outages.org > https://puck.nether.net/mailman/listinfo/outages-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://puck.nether.net/pipermail/outages-discussion/attachments/20211004/c5ec724f/attachment-0001.htm> ------------------------------ Message: 2 Date: Tue, 5 Oct 2021 03:28:09 +0000 From: "Chapman, Brad (NBCUniversal)" <brad.chap...@nbcuni.com> To: Jay Ashworth <j...@baylink.com> Cc: Gary Josack <g...@byoteki.com>, "Patrick W. Gilmore" <patr...@ianai.net>, "o...@delong.com" <o...@delong.com>, outages-discussion <outages-discussion@outages.org> Subject: [Outages-discussion] On the subject of root cause analyses and postmortems... Message-ID: <f06f3875-4454-4474-8421-bb8a6ff62...@tfayd.com> Content-Type: text/plain; charset="utf-8" Howdy Jay, In light of today?s Facebook outage, I thought I?d inquire as to how your new book about complex failure analysis is coming along. Below is the cover art I proposed at the start of the pandemic, with some new owls as requested. :-) Cheers, Brad [A group of people in garment Description automatically generated with low confidence][A picture containing text, bird of prey, bird, owl Description automatically generated] From: Outages-discussion <outages-discussion-boun...@outages.org> on behalf of "Chapman, Brad (NBCUniversal)" <brad.chap...@nbcuni.com> Date: Sunday, March 22, 2020 at 8:52 PM To: Jay Ashworth <j...@baylink.com>, Gary Josack <g...@byoteki.com>, "Patrick W. Gilmore" <patr...@ianai.net> Cc: OUTAGES Discussion List <outages-discussion@outages.org> Subject: Re: [Outages-discussion] [EXTERNAL] Re: [outages] Discord: Sever outages and Increased API errors Hmm, you have a point. Maybe the three wise guys are a more appropriate animal metaphor... From: Jay Ashworth <j...@baylink.com> Date: Sunday, March 22, 2020 at 8:52 AM To: "Chapman, Brad (NBCUniversal)" <brad.chap...@nbcuni.com>, Gary Josack <g...@byoteki.com>, Gary Josack via Outages <outa...@outages.org>, "Patrick W. Gilmore" <patr...@ianai.net> Subject: Re: [EXTERNAL] Re: [outages] Discord: Sever outages and Increased API errors Yeah, but that's an owl, with a 360-degree neck. Shouldn't it have been facing away from the camera? :-) On March 22, 2020 2:03:04 AM EDT, "Chapman, Brad (NBCUniversal)" <brad.chap...@nbcuni.com> wrote: Whenever you decide to publish such a book, I?ve got your title and cover art ready... Put me down for a pre-order. -Brad [A close up of a bird Description automatically generated] From: Outages <outages-boun...@outages.org> on behalf of Jay Ashworth via Outages <outa...@outages.org> Reply-To: Jay Ashworth <j...@baylink.com> Date: Friday, March 20, 2020 at 9:07 PM To: Gary Josack <g...@byoteki.com>, Gary Josack via Outages <outa...@outages.org>, "Patrick W. Gilmore" <patr...@ianai.net> Cc: outages <outa...@outages.org> Subject: [EXTERNAL] Re: [outages] Discord: Sever outages and Increased API errors I am sufficiently interested that I'm seriously considering writing a book on this topic actually. That was a very nice write-up. Do I correctly understand, then, that the root cause was the broken golang library function / routine? (For the moment, we will pass on the topic of the irony of having to come up with an alternate name for your own language because otherwise people won't be able to find things about it... in the search engine you run that you wrote it for :-) Way to go Google.) On March 20, 2020 11:54:08 PM EDT, Gary Josack via Outages <outa...@outages.org> wrote: If anyone is interested we published a post mortem on our status page for this incident. https://status.discordapp.com/incidents/62gt9cgjwdgf<https://urldefense.com/v3/__https:/status.discordapp.com/incidents/62gt9cgjwdgf__;!!PIZeeW5wscynRQ!9IlozgcLDbWntVNJYRLbLSjlkY1RnEa2iRitGoMKZBTwtilpUibKlSbLxIv4M9w-XQ$> On Mon, Mar 16, 2020 at 2:49 PM Patrick W. Gilmore via Outages <outa...@outages.org<mailto:outa...@outages.org>> wrote: Discord seems to be having issues. It is showing on Down Detector. The splash page says: [https://files.slack.com/files-pri/T2F7AJRMY-FV5C2QE4A/image.png] [cid:170fb3917e5a2da56b91] The Server Status page shows: [cid:170fb3917e5774fd4222] Mostly FYI. -- TTFN, patrick _______________________________________________ Outages mailing list outa...@outages.org<mailto:outa...@outages.org> https://puck.nether.net/mailman/listinfo/outages<https://urldefense.com/v3/__https:/puck.nether.net/mailman/listinfo/outages__;!!PIZeeW5wscynRQ!9IlozgcLDbWntVNJYRLbLSjlkY1RnEa2iRitGoMKZBTwtilpUibKlSbLxIs82I34TA$> -- Sent from my Android device with K-9 Mail. Please excuse my brevity. -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://puck.nether.net/pipermail/outages-discussion/attachments/20211005/ca460083/attachment.htm> -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 61320 bytes Desc: image001.png URL: <https://puck.nether.net/pipermail/outages-discussion/attachments/20211005/ca460083/attachment.png> -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 81589 bytes Desc: image002.png URL: <https://puck.nether.net/pipermail/outages-discussion/attachments/20211005/ca460083/attachment-0001.png> ------------------------------ Subject: Digest Footer _______________________________________________ Outages-discussion mailing list Outages-discussion@outages.org https://puck.nether.net/mailman/listinfo/outages-discussion ------------------------------ End of Outages-discussion Digest, Vol 140, Issue 8 **************************************************