Okay, just resolved this from my end. My O365 emails were being DKIM signed
but by our .onmicrosoft.com subdomain instead of the actual sending
domain. Headers would show dkim=pass but the DKIM domain didn't match the
FROM address in our envelopes.
Had to enable DKIM signing on the custom domain
Massive problems with email delivery to Yahoo and AOL today, they share a
mail system on the back-end. Microsoft issued advisory EX719348 last
Thursday for their IPs being included in some DNSRBLs, and I still see some
of their IPs on the Spamhaus RBL (40.107.102.127) but I'm not sure if
that's th
Equinix DC2? There's a whole lot of DC2's in Ashburn.
- Cary
On Mon, Oct 30, 2023 at 2:27 PM Randy Bush via Outages
wrote:
> anyone else have excitement at ashburn dc2 about an hour ago? not
> power. but as if our pnis were all bounced.
>
> randy
> ___
Just spoke to Spectrum about my Fort Worth, Texas site and they say there's
a massive multi-node outage impacting thousands of customers.
TV/Internet/Phone all down.
Spectrum's master outage ticket is #INC27382946. No ETA yet.
Dallas sites 30 miles east seem fine.
- Cary
On Wed, Jul 12, 20
My Thousand Oaks, CA site on Spectrum (off-the-shelf DOCSIS) is up and
working fine, so you're probably impacted by a single node outage.
This list is really for massive outages and multi-customer fiber cuts, not
single-provider outages that only impact one zip code. Call Spectrum
business back a
"WoW" here is Wide Open West aka wowway.com.
Confirming I have a hard down WoW Cable site in Naperville, IL. Another
previously WoW site that transitioned to Astound/RCN last year is still up.
- Cary
On Tue, Nov 15, 2022 at 12:46 PM Begarowicz, Shawn via Outages <
outages@outages.org> wrote:
>
Confirmed auth outage. They posted about it a few hours ago:
https://community.meraki.com/t5/Meraki-Service-Notices/Meraki-Auth-Issues/ba-p/142206
I also get a banner on top of my logged-in Dashboard sessions:
[image: image.png]
Not good.
- Cary
On Thu, Mar 10, 2022 at 12:57 PM Bruce Freshwater
Confirming major Comcast issues impacting the PA/NJ region starting at
8:06am and spreading to Chicagoland at 8:24am EST. Other regions thus far
unaffected.
Quick packet loss graph from the perspective of a NJ location:
[image: image.png]
I'm hearing TV services are affected too.
- Cary
On Tu
Details scant so far, but there's something awful going on with DNS for a
large portion of the Internet, especially Azure.
Microsoft just posted this to Twitter via @MSFT365Status:
[image: image.png]
https://twitter.com/MSFT365Status/status/1377738432265396225
But I have vendors using UltraDNS (f
Also confirming widespread loss to most destinations, although it seems to
have just cleared at 21:54:29 EST:
[image: image.png]
DC and Maryland were affected, but Northern Virginia
(Alexandria/Arlington/Falls Church/Reston) was unaffected.
- Cary
On Tue, Mar 2, 2021 at 9:56 PM Patrick Shoemake
We have full recovery as of 21:40:18 EST / 18:48:18 PST.
Massive, but at least brief.
Thanks all for your reports.
- Cary
On Mon, Feb 22, 2021 at 9:30 PM Cary Wiedemann
wrote:
> Early report that I have several Spectrum sites down in the Northwestern
> Los Angeles suburbs from Santa Clarita t
Early report that I have several Spectrum sites down in the Northwestern
Los Angeles suburbs from Santa Clarita to Thousands Oaks and everything in
between.
Our LA proper circuits seem unaffected.
Outages of this scale are rare. This goes well beyond a single node (or
hub) outage. We're dealing
Confirming FiOS sites with ~30-40% loss down most paths from Massachusetts
to Northern Virginia.
FiOS to AT&T in the DC region:
[image: image.png]
FiOS in Massachusetts to Google's local 8.8.8.8 anycasted resolver:
[image: image.png]
FiOS in Manhattan to AT&T:
[image: image.png]
Worst FiOS outa
If you noticed your Comcast sites all over the country were down last night
it was due to a botched firmware upgrade pushed to many Cisco modems.
Comcast Business uses Cisco DPC3941B modems in many regions and these were
particularly affected.
Comcast can't reboot these modems remotely anymore. T
Just chiming in to say I see it too, but it's not the last-mile, only
certain paths are affected:
[image: image.png]
My client here is in another netblock 47.196.128.0/18 but still affected.
Some paths with no loss (like to Cox Cable) do have crazy high 400+ms
latency, whereas the path to AT&T is
gt;
> The team is working on it.
>
> _
> *Justin Paine*
> Head of Trust & Safety
> PGP: BBAA 6BCE 3305 7FD6 6452 7115 57B6 0114 DE0B 314D
> <https://keys.openpgp.org/vks/v1/by-fingerprint/BBAA6BCE33057FD66452711557B60114DE0B314D>
> 101 Townsend St., San Francisco, CA 94107
&
Widespread DNS trouble in the last few hours, including an outage of
CloudFlare's 1.1.1.1.
Maybe related to CVE-2020-1350? I doubt it.
Early report, more info coming.
- Cary
___
Outages mailing list
Outages@outages.org
https://puck.nether.net/mailman/
I've definitely seen loss from FiOS circuits in Manhattan and Long Island
to many routes (examples: AT&T and Cox, but not Google's local 8.8.8.8
resolver) starting around 8:45pm EDT last night.
Some graphs:
24-hour Long Island FiOS to Cox:
[image: image.png]
2-hour Long Island FiOS to Cox:
[image:
Hey All,
There's a few threads on this already, but they all call out specific ISPs
when this trouble isn't limited to any one last-mile provider. Nearly all
tier 1 transit providers are experiencing loss on the US West Coast today.
Some examples:
Comcast/Level3 peering point in Seattle:
[image:
Clear here in East US, but there's dashboard notices posted now and they
admitted trouble with "Outlook on the web" on Twitter a few hours ago:
https://twitter.com/MSFT365Status/status/1252383164586053634
Most the Twitter comments report trouble in AU specifically.
Can't access mailbox via Outloo
Looks like GTT backbone problems to me. Especially affecting Time Warner
(Spectrum) circuits. My loss rate graphs to AT&T are swiss cheese:
[image: image.png]
WAN1 is legacy Time Warner, WAN2 is Frontier Telephone.
It's like this for every route with GTT in the path. Started happening
yesterda
There's a few local media reports popping up:
https://www.pressherald.com/2020/02/07/cable-service-out-in-much-of-maine-possibly-part-of-larger-outage/
https://www.wmtw.com/article/spectrum-outage-affects-maine-and-new-hampshire-customers/30815470#
Sounds like two separate fiber cuts. I wonder ho
Spectrum is telling me there's a "hub" outage, which connect their "nodes"
together. Outage began at 3:25pm EST.
Inbound traces through the old Time Warner (RoadRunner) network fail in NYC.
Internet and TV are both affected, I'm sure voice is out too.
Fiber cut? They haven't provided any detai
Just confirming this outage affected my sites from Virginia to California.
Start time was just before 2:32pm EST and resolution came around 2:54pm EST.
Looks like anycast routing woes. Not good.
- Cary
On Thu, Jan 23, 2020 at 3:38 PM Chris Cherry via Outages <
outages@outages.org> wrote:
> No
Hey all,
Just so you don't tear your hair out like I did, it looks like Microsoft
has a bad authoritative DNS server for subdomain ha.office365.com today
which is interfering with autodiscover processes.
cary@CaryBox:~$ host autodiscover.outlook.com
autodiscover.outlook.com is an alias for autod.
I'm hearing problem across the entire Azure platform. SQL servers down,
blob storage not working, Teams misbehaving, etc.
[image: image.png]
Their Service Health dashboard only loads half the time.
Not a good day for Microsoft.
- Cary
On Thu, May 2, 2019 at 4:47 PM Chaim Rieger via Outages
wr
Confirmed again, it's the entire DC region. Routes to Google, Yahoo, AT&T,
etc. have been in and out since the 5am hour.
Packet loss graph to 8.8.8.8:
[image: image.png]
- Cary
On Sun, Nov 18, 2018 at 2:58 PM Stacy Smith via Outages
wrote:
> Up through Laurel MD as well.
>
> On Nov 18, 2018,
Second night in a row. Tennessee, Illinois, Georgia, and Michigan tonight
here, not as severe as last night.
Seems like unscheduled maintenance to me, rebooting head end concentrators
or something. My sites came back ~5 minutes later just like last night.
- Cary
On Thu, Nov 1, 2018 at 2:48 AM
Even their WHOIS server whois.godaddy.com is down. This is awful. My TTLs
are too short.
- Cary
On Sun, Oct 28, 2018 at 7:14 PM Cary Wiedemann
wrote:
> Nobody can log into their GoDaddy accounts right now. I also have two
> authoritative DNS servers for a few of my domains not responding:
>
Nobody can log into their GoDaddy accounts right now. I also have two
authoritative DNS servers for a few of my domains not responding:
ns29.domaincontrol.com
ns30.domaincontrol.com
Just spoke to GoDaddy support and they're aware of the problem and say it
started "45 minutes ago" as of 7:10pm EDT
Seems this was localized. My site in South Brooklyn saw massive packet
loss on Cablevision/Optimum, but another site 5 miles east was unaffected.
Packet loss graph:
Hyper localized.
- Cary
On Thu, Jul 19, 2018 at 9:42 AM, Izzy Goldstein - TeleGo via Outages <
outages@outages.org> wrote:
> Opt
Main markets affected for me seem to be Atlanta and Chicago, but also have
sites down in Florida, Colorado, Washington State.
DC to New York region seems unaffected.
Even their call center is down.
Awful.
- Cary Wiedemann
On Fri, Jun 29, 2018 at 12:44 PM, Neader, Brent via Outages <
outages@ou
Thank you John! I see a new path from Ashburn to the Northeast via
Marietta, GA and Chicago.
All is working well with no loss; confirmed resolved on this side. All 50+
of my sites are back up.
Thanks again!
- Cary Wiedemann
On Wed, Aug 2, 2017 at 10:12 AM, John Neiberger via Outages <
outages
All,
Our AT&T BVOIP service is down nationwide. Our account managers are
frantically looking into it but we don't have an official statement yet.
Anyone else experiencing this or have any explanations? It's supposedly
affecting the entire platform.
Our PNT private line circuits are all up, it
I use EasyNet transit in the UK and they've had an outage ongoing for 8
hours 15 minutes due to low light.
EasyNet claims not to own the affected fiber and reports that many other
carriers are also affected.
EasyNet network status page available here:
http://support.uk.easynet.net/support_status.
More than just their 'pdns' premium DNS servers are down today.
NS31.DOMAINCONTROL.COM and NS32.DOMAINCONTROL.COM ping but don't respond to
A or MX requests regardless of where I source from:
(From Savvis)
cary@brn-web-ftp:~$ dig +trace a sunriseseniorliving.com +short
NS m.root-servers.net. from
36 matches
Mail list logo
