Send Outages-discussion mailing list submissions to
outages-discussion@outages.org
To subscribe or unsubscribe via the World Wide Web, visit
https://puck.nether.net/mailman/listinfo/outages-discussion
or, via email, send a message with subject or body 'help' to
outages-discussion-requ...@outages.org
You can reach the person managing the list at
outages-discussion-ow...@outages.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Outages-discussion digest..."
Today's Topics:
1. Re: [outages] Spectrum/LTWC Ohio/KY (Jared Mauch)
2. Re: [outages] Vocus routing US Salesforce.com traffic through
Australia? (Jay Hennigan)
3. Re: [EXTERNAL] Re: [outages] Reddit very slow but not dead
(Chapman, Brad (NBCUniversal))
----------------------------------------------------------------------
Message: 1
Date: Tue, 7 Sep 2021 20:43:11 -0400
From: Jared Mauch <ja...@puck.nether.net>
To: Ross Tajvar <r...@tajvar.io>
Cc: outages-discussion <outages-discussion@outages.org>
Subject: Re: [Outages-discussion] [outages] Spectrum/LTWC Ohio/KY
Message-ID: <94f1096f-ccf0-4473-adda-12c09abf6...@puck.nether.net>
Content-Type: text/plain; charset="utf-8"
Doug corrected me. It's not this there were some route leaks from a previously
unseen ASN in the global table assigned to charter.
https://twitter.com/dougmadory/status/1435394595274334208?s=21
Sent from my TI-99/4a
> On Sep 7, 2021, at 7:35 PM, Jared Mauch <ja...@puck.nether.net> wrote:
>
> ?Starting around 1646 UTC there started to be some BGP instability out there
> in the internet, it looks to be related to announcements that originated from
> this network (as7713)
>
> TIME: 09/07/21 17:17:06.677443
> TYPE: BGP4MP_ET/MESSAGE/Update
> FROM: 85.114.0.217 AS8492
> TO: 128.223.51.102 AS6447
> ORIGIN: IGP
> ASPATH: 8492 31133 7713
> NEXT_HOP: 85.114.0.217
> UNKNOWN_ATTR(224, 255, 22): 00 00 07 db 00 00 00 01 00 01 00 0a ff 08 00
> 00 00 00 5a f0 eb 10
> COMMUNITY: 8492:1104 8492:1602
> ANNOUNCE
> 36.75.168.0/21
> 36.84.8.0/22
> 36.68.116.0/22
> 36.85.104.0/22
> 36.85.100.0/22
> 36.75.164.0/22
> 36.75.176.0/23
> 110.136.150.0/23
> 180.242.72.0/23
>
> It seemed to subside about an hour later at 17:43 UTC. This caused increased
> BGP churn you can see in graphs like this that monitor BGP announcements
> (add).
>
> <Screen Shot 2021-09-07 at 2.28.16 PM.png>
>
>
> - Jared
>
>> On Sep 7, 2021, at 7:08 PM, Ross Tajvar <r...@tajvar.io> wrote:
>>
>> Care to elaborate on the attributes in question?
>>
>> On Tue, Sep 7, 2021, 7:05 PM Jared Mauch via Outages <outa...@outages.org>
>> wrote:
>> Sorry just saw this. I think this may have been related to some unknown BGP
>> attributes today and I expect their BGP was flapping as a result.
>>
>> Sent from my TI-99/4a
>>
>>> On Sep 7, 2021, at 6:24 PM, Ben Groves via Outages <outa...@outages.org>
>>> wrote:
>>>
>>> ?
>>> Per Spectrum NOC, the issue has been resolved.
>>> "The Spectrum Enterprise NOC confirmed that a routing issue was found by
>>> Spectrum Enterprise Engineering team once corrected the severe packet loss
>>> and intermittent connectivity that customers were experiencing. This will
>>> serve as the final notification for this event. "
>>>
>>> On Tue, Sep 7, 2021, 1:14 PM Josh Luthman via Outages <outa...@outages.org>
>>> wrote:
>>> Looks like there is an issue with the coax network.
>>> > /tool traceroute 1.1.1.1
>>> # ADDRESS LOSS SENT LAST AVG BEST
>>> WORST
>>> 1 142.254.145.13 9.8% 143 timeout 13.5 7.9
>>> 100.7
>>> 2 24.29.6.105 9.1% 143 24.3ms 42.4 13.4
>>> 226.8
>>> 3 65.29.36.238 10.. 143 14.1ms 19.7 9.8
>>> 179.4
>>> 4 65.29.1.46 14% 143 25ms 27.2 16.7
>>> 95.6
>>> 5 66.109.6.66 10.. 143 34.1ms 30.7 23.8
>>> 141.6
>>> 6 66.109.3.24 13.. 143 26.6ms 35.4 24.5
>>> 202
>>> 7 209.18.43.59 8.4% 143 28.3ms 30.7 24.3
>>> 95.1
>>> 8 173.245.63.56 12.. 143 42.2ms 39.3 27.5
>>> 135.5
>>> 9 172.70.44.4 11.. 142 43.5ms 35.1 24.2
>>> 161.6
>>> 10 1.1.1.1 6.3% 142 44.1ms 33.4 24.1
>>> 149.8
>>> 11 1.1.1.1 0% 1 26.1ms 26.1 26.1
>>> 26.1
>>>
>>>
>>> Fiber DIA seems just fine to me.
>>>
>>> > /tool traceroute 1.1.1.1
>>> # ADDRESS LOSS SENT LAST AVG BEST
>>> WORST
>>> 1 10.10.10.1 0% 171 0.3ms 0.3 0.3
>>> 3.6
>>> 2 192.149.254.1 0% 171 0.4ms 0.4 0.3
>>> 1.3
>>> 3 74.218.88.129 0% 171 2ms 1.4 0.6
>>> 31.9
>>> 4 65.189.190.189 0% 171 8.7ms 10.4 0.8
>>> 143.4
>>> 5 65.29.38.112 0% 171 14.2ms 12.5 8.3
>>> 16.9
>>> 6 65.29.1.46 0% 170 11.4ms 9.6 8.2
>>> 14.9
>>> 7 66.109.6.12 0% 170 17.5ms 16.5 16.1
>>> 20
>>> 8 66.109.3.24 0% 170 16.9ms 17.1 16.5
>>> 42.2
>>> 9 209.18.43.59 0% 170 26.2ms 20.2 16.2
>>> 64.7
>>> 10 24.30.200.73 0% 170 20.4ms 31.1 16.7
>>> 89.4
>>> 11 172.70.44.2 0% 170 17.2ms 19.5 16.6
>>> 72.3
>>> 12 1.1.1.1 0% 170 16.2ms 16.4 16.2
>>> 31.5
>>>
>>> Josh Luthman
>>> 24/7 Help Desk: 937-552-2340
>>> Direct: 937-552-2343
>>> 1100 Wayne St
>>> Suite 1337
>>> Troy, OH 45373
>>>
>>>
>>> On Tue, Sep 7, 2021 at 1:09 PM Savarrah Goss via Outages
>>> <outa...@outages.org> wrote:
>>> https://app.fing.com/internet/outage/DROP:US-Ohio--Spectrum%20Business@2021-09-07-1650-00000
>>>
>>>
>>>
>>> Savarrah Goss | Hamilton Relay
>>>
>>> O: 229.338.7086 | C: 229.854.8872 | savarrah.g...@hamiltonrelay.com |
>>> HamiltonRelay.com
>>>
>>>
>>>
>>> Hamilton Relay | @HamiltonRelay
>>>
>>>
>>>
>>> From: Outages <outages-boun...@outages.org> On Behalf Of Mike Markwood via
>>> Outages
>>> Sent: Tuesday, September 7, 2021 1:00 PM
>>> To: 'outa...@outages.org' <outa...@outages.org>; Neader, Brent
>>> <brent.nea...@druryhotels.com>
>>> Subject: Re: [outages] Spectrum/LTWC Ohio/KY
>>>
>>>
>>>
>>> **This email originated from outside of the Hamilton network. Please use
>>> extra caution with links and attachments. **
>>>
>>> We're seeing our Spectrum cable modem customers across Northeast Ohio
>>> bouncing as well as Columbus, OH and a few customers in TN.
>>>
>>>
>>>
>>> Mike Markwood | Director of Network Operations
>>> P: 866.986.1066 E: mmarkw...@geostarllc.net
>>>
>>> 1000 S. Cleveland Massillon Road, Suite 3
>>> Fairlawn, OH 44333
>>>
>>>
>>>
>>>
>>>
>>> From: Outages <outages-boun...@outages.org> on behalf of Neader, Brent via
>>> Outages <outa...@outages.org>
>>> Sent: Tuesday, September 7, 2021 12:52 PM
>>> To: 'outa...@outages.org' <outa...@outages.org>
>>> Subject: [outages] Spectrum/LTWC Ohio/KY
>>>
>>>
>>>
>>> Seeing enterprise DIA sites drop off and come back repeatedly in these
>>> areas, Dayton, Cinci, Cleveland, Middletown, Louisville.
>>>
>>>
>>>
>>>
>>>
>>> CONFIDENTIALITY NOTE: This email and any attachments are confidential and
>>> may be protected by legal privilege. If you have received this email in
>>> error, please immediately notify the sender by return email and delete all
>>> copies of this email.
>>> _______________________________________________
>>> Outages mailing list
>>> outa...@outages.org
>>> https://puck.nether.net/mailman/listinfo/outages
>>> _______________________________________________
>>> Outages mailing list
>>> outa...@outages.org
>>> https://puck.nether.net/mailman/listinfo/outages
>>> _______________________________________________
>>> Outages mailing list
>>> outa...@outages.org
>>> https://puck.nether.net/mailman/listinfo/outages
>> _______________________________________________
>> Outages mailing list
>> outa...@outages.org
>> https://puck.nether.net/mailman/listinfo/outages
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<https://puck.nether.net/pipermail/outages-discussion/attachments/20210907/707cf22b/attachment-0001.htm>
------------------------------
Message: 2
Date: Wed, 8 Sep 2021 18:26:49 -0700
From: Jay Hennigan <j...@west.net>
To: "outages-discussion@outages.org" <outages-discussion@outages.org>
Subject: Re: [Outages-discussion] [outages] Vocus routing US
Salesforce.com traffic through Australia?
Message-ID: <a9c1fccf-97de-477f-b0ac-a879254aa...@west.net>
Content-Type: text/plain; charset=utf-8; format=flowed
We're seeing routing to Australia as well via direct peering with Vocus
in Los Angeles. Judging from the latency, the target host seems to be in
Australia and not coming back to the US.
$ traceroute --resolve-hostnames 23.1.35.132
traceroute to 23.1.35.132 (23.1.35.132), 64 hops max
1 207.154.71.210 (gi2-46.border0.gta.impulse.net) 0.314ms 0.274ms
0.277ms
2 205.254.246.12 (xe2-0-1-418-border2.lax.impulse.net) 2.725ms
2.619ms 2.669ms
3 206.72.210.136 (vocus-connect-pty.as4826.any2ix.coresite.com)
3.017ms 3.119ms 3.136ms
4 114.31.199.34 (be101.bdr03.sjc01.ca.us.vocus.network) 159.183ms
159.207ms 158.747ms
5 114.31.199.33 (be100.bdr04.sjc01.ca.us.vocus.network) 162.070ms
* *
6 114.31.199.40 (be203.cor01.syd11.nsw.vocus.network) 161.883ms
161.873ms 161.874ms
7 49.255.173.74 (static-74.173.255.49.in-addr.VOCUS.net.au)
382.480ms 165.217ms 160.404ms
8 23.1.240.229 (a23-1-240-229.deploy.static.akamaitechnologies.com)
158.952ms 158.603ms 158.626ms
9 * * *
10 49.255.173.73 (static-73.173.255.49.in-addr.VOCUS.net.au)
159.055ms 159.083ms 159.116ms
11 23.1.35.132 (a23-1-35-132.deploy.static.akamaitechnologies.com)
158.496ms 158.488ms 158.504ms
--
Jay Hennigan - j...@west.net
Network Engineering - CCIE #7880
503 897-8550 - WB6RDV
------------------------------
Message: 3
Date: Wed, 22 Sep 2021 22:58:22 +0000
From: "Chapman, Brad (NBCUniversal)" <brad.chap...@nbcuni.com>
To: "outages-discussion@outages.org" <outages-discussion@outages.org>
Cc: outages <outa...@outages.org>
Subject: Re: [Outages-discussion] [EXTERNAL] Re: [outages] Reddit very
slow but not dead
Message-ID: <65a1de11-143a-45c4-9d96-2e9144cab...@tfayd.com>
Content-Type: text/plain; charset="utf-8"
I love that their status page says ?All Systems Operational? but the last slice
is RED. I can?t remember the last time that?s happened...
[Timeline Description automatically generated]
From: Outages <outages-boun...@outages.org> on behalf of John Barbieri via
Outages <outa...@outages.org>
Reply-To: John Barbieri <tenpin...@gmail.com>
Date: Wednesday, September 22, 2021 at 3:24 PM
To: Paul M - outages <paul+outa...@mansfield.co.uk>
Cc: outages <outa...@outages.org>
Subject: [EXTERNAL] Re: [outages] Reddit very slow but not dead
And this whole time I thought it was my ISP or dns (was playing with my dns
servers about an hour ago). Their main page would load, but any subreddits or
posts wouldn't load.
On Wed, Sep 22, 2021, 18:02 Paul M - outages via Outages
<outa...@outages.org<mailto:outa...@outages.org>> wrote:
Slow page and app loading:
https://www.redditstatus.com/<https://urldefense.com/v3/__https:/www.redditstatus.com/__;!!PIZeeW5wscynRQ!-dcBX2v2iluyeg3kIKYr1QtTCCY4kIhRTxDZBSVgdk_keKHsWwHwOGYv5bfPZSH68g$>
As per the list rules, web sites normally don't matter but a big service like
reddit might raise complaints to customer services.
_______________________________________________
Outages mailing list
outa...@outages.org<mailto:outa...@outages.org>
https://puck.nether.net/mailman/listinfo/outages<https://urldefense.com/v3/__https:/puck.nether.net/mailman/listinfo/outages__;!!PIZeeW5wscynRQ!-dcBX2v2iluyeg3kIKYr1QtTCCY4kIhRTxDZBSVgdk_keKHsWwHwOGYv5bemLmyUyg$>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<https://puck.nether.net/pipermail/outages-discussion/attachments/20210922/b202c2c4/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 171830 bytes
Desc: image001.png
URL:
<https://puck.nether.net/pipermail/outages-discussion/attachments/20210922/b202c2c4/attachment.png>
------------------------------
Subject: Digest Footer
_______________________________________________
Outages-discussion mailing list
Outages-discussion@outages.org
https://puck.nether.net/mailman/listinfo/outages-discussion
------------------------------
End of Outages-discussion Digest, Vol 139, Issue 5
**************************************************
