Re: [AusNOG] My condolences to the people trying to sort out remote learning

2020-04-19 Thread Dave Taht
On Sun, Apr 19, 2020 at 10:50 PM Peter Tiggerdine  wrote:
>
> How was the CPE implementation and support issue being?
>
> I'm still seeing a number poorly implemented mixed RA/DHCPv6 going on in 
> CPE's.

I happen to be pretty happy with openwrt and dd-wrt at this point, as
regards to ipv6 support.

One favorite feature for me is that they use source specific routing
for ipv6, which is an elegant solution to the bcp38
problem ipv4 has.

default from 2601:never:you:mind:6fe3 via fe80::22e5:2aff:feb8:14f dev
eth0.2 proto static metric 512 pref medium
default from 2601:never:you:mind::/60 via fe80::22e5:2aff:feb8:14f dev
eth0.2 proto static metric 512 pref medium

with no other default route in place, nothing escapes.

Others include autoassignment of ipv6 prefixes across interfaces,
dnsmasq naming for slaac, pretty good set of default fw rules,
wireguard, sqm etc, etc. And they've always supported every ipv6
tunneling method there was, if you can't go native.

> Regards,
>
> Peter Tiggerdine
>
> GPG Fingerprint: 2A3F EA19 F6C2 93C1 411D 5AB2 D5A8 E8A8 0E74 6127
>
>
> On Mon, Apr 20, 2020 at 3:31 PM Karl Auer  wrote:
>>
>> On Mon, 2020-04-20 at 05:07 +, Mark Delany wrote:
>> > FWIW, I've never touched jitsi before in my life but even I managed
>> > to follow a cookbook and get a dual-stack server up and running in a
>> > few hours. I was tempted to drop the A RR just to see how many users
>> > would squeal, but that would be too cruel in Australia.
>>
>> Where? I don't mean "give me access" :-) I mean, where did you set it
>> up? AWS, Azure, own DC? At home?
>>
>> Also, which cookbook did you follow?
>>
>> Regards, K.
>>
>> --
>> ~~~
>> Karl Auer (ka...@biplane.com.au)
>> http://www.biplane.com.au/kauer
>> http://twitter.com/kauer389
>>
>> GPG fingerprint: 2561 E9EC D868 E73C 8AF1 49CF EE50 4B1D CCA1 5170
>> Old fingerprint: 8D08 9CAA 649A AFEF E862 062A 2E97 42D4 A2A0 616D
>>
>>
>> ___
>> AusNOG mailing list
>> AusNOG@lists.ausnog.net
>> http://lists.ausnog.net/mailman/listinfo/ausnog
>
> ___
> AusNOG mailing list
> AusNOG@lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog



-- 
Make Music, Not War

Dave Täht
CTO, TekLibre, LLC
http://www.teklibre.com
Tel: 1-831-435-0729
___
AusNOG mailing list
AusNOG@lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog


Re: [AusNOG] My condolences to the people trying to sort out remote learning

2020-04-19 Thread Peter Tiggerdine
How was the CPE implementation and support issue being?

I'm still seeing a number poorly implemented mixed RA/DHCPv6 going on in
CPE's.

Regards,

Peter Tiggerdine

GPG Fingerprint: 2A3F EA19 F6C2 93C1 411D 5AB2 D5A8 E8A8 0E74 6127


On Mon, Apr 20, 2020 at 3:31 PM Karl Auer  wrote:

> On Mon, 2020-04-20 at 05:07 +, Mark Delany wrote:
> > FWIW, I've never touched jitsi before in my life but even I managed
> > to follow a cookbook and get a dual-stack server up and running in a
> > few hours. I was tempted to drop the A RR just to see how many users
> > would squeal, but that would be too cruel in Australia.
>
> Where? I don't mean "give me access" :-) I mean, where did you set it
> up? AWS, Azure, own DC? At home?
>
> Also, which cookbook did you follow?
>
> Regards, K.
>
> --
> ~~~
> Karl Auer (ka...@biplane.com.au)
> http://www.biplane.com.au/kauer
> http://twitter.com/kauer389
>
> GPG fingerprint: 2561 E9EC D868 E73C 8AF1 49CF EE50 4B1D CCA1 5170
> Old fingerprint: 8D08 9CAA 649A AFEF E862 062A 2E97 42D4 A2A0 616D
>
>
> ___
> AusNOG mailing list
> AusNOG@lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog
>
___
AusNOG mailing list
AusNOG@lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog


Re: [AusNOG] My condolences to the people trying to sort out remote learning

2020-04-19 Thread Karl Auer
On Mon, 2020-04-20 at 05:07 +, Mark Delany wrote:
> FWIW, I've never touched jitsi before in my life but even I managed
> to follow a cookbook and get a dual-stack server up and running in a
> few hours. I was tempted to drop the A RR just to see how many users
> would squeal, but that would be too cruel in Australia.

Where? I don't mean "give me access" :-) I mean, where did you set it
up? AWS, Azure, own DC? At home?

Also, which cookbook did you follow?

Regards, K.

-- 
~~~
Karl Auer (ka...@biplane.com.au)
http://www.biplane.com.au/kauer
http://twitter.com/kauer389

GPG fingerprint: 2561 E9EC D868 E73C 8AF1 49CF EE50 4B1D CCA1 5170
Old fingerprint: 8D08 9CAA 649A AFEF E862 062A 2E97 42D4 A2A0 616D


___
AusNOG mailing list
AusNOG@lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog


Re: [AusNOG] My condolences to the people trying to sort out remote learning

2020-04-19 Thread Mark Delany
> The problem is and always has been NAT. You need an external rendezvous

Makes you wonder why more Australian RSPs don't do ipv6.

Unfortunately all those RSPs who are still v4-only have missed the
boat and now their customers will feel a lot more pain over the coming
months than customers on a dual-stack RSP. Churning is pretty easy if
you're on the NBN. Just sayin.

And for those of you setting up your own jitsi servers or similar, of
course you'll deploy on a dual-stack server to maximize the prospect
of your users/customers getting a better experience. Yes?

FWIW, I've never touched jitsi before in my life but even I managed to
follow a cookbook and get a dual-stack server up and running in a few
hours. I was tempted to drop the A RR just to see how many users would
squeal, but that would be too cruel in Australia.


Mark.
___
AusNOG mailing list
AusNOG@lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog


[AusNOG] Bibra Lake smart hands

2020-04-19 Thread Scott Wilson
Hi All,

Looking for some smart hands to help us diagnose an edge machine that's
dropped off our site reliability agent this morning at Bibra Lake in Perth.
Will need a HDMI screen, keyboard, probably hivis and steelcaps. Replies
off list please.
___
AusNOG mailing list
AusNOG@lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog


[AusNOG] AS6507 IP Changes in NSW-IX and Megaport IX Sydney

2020-04-19 Thread Jimmy He
Hi all,

We just migrated to a new facility and due to time constraints, we have new
IPs in NSW-IX and Megaport Sydney. Please email peer...@riotgames.com if
you see any issues via the router servers.

Cheers,

Jimmy


Jimmy He

Senior Network Engineer  | Riot Games
___
AusNOG mailing list
AusNOG@lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog


Re: [AusNOG] My condolences to the people trying to sort out remote learning

2020-04-19 Thread James Andrewartha
On Mon, 20 Apr 2020, Bill Woodcock wrote:

> FWIW, I’ve been looking at a lot of the options, and I know a lot of other 
> people who have as well, for various school districts and universities, and 
> the best option (mainly from a 
> not-exposing-children-to-malware-and-naked-Nazi-zoombombers perspective) is 
> BigBlueButton.  It’s open-source, well-supported, and runs entirely sandboxed 
> in the browser, HTML5, like Jitsi, but with an online-classroom focus rather 
> than a business-meeting focus.
> 
> https://github.com/bigbluebutton/bigbluebutton
> 
> That said, I’m not trying to use it in production myself.  Friends who are 
> say it’s mostly great, but the audio quality isn’t as good as some of the 
> commercial options.  Which isn’t surprising.  Audio noise cancellation is the 
> subject of a million patents, and patent-trolls.

As mentioned previously we're running BBB in production, although right 
now it's school holidays. There's interesting comments on audio quality in 
https://github.com/bigbluebutton/bigbluebutton/issues/7007 which I haven't 
had time to dive in to. Our music teachers mostly complain that the audio 
cuts out during loud or staccato periods.

And thanks Rob for the kind words. Our go live for remote learning was a 
few weeks ago, and despite several tests 4 separate components fell over 
due to excess load. It was a stressful morning alright, but I sat back, 
took a breath and worked on them one-by-one and everything was running 
smoothly within a day, and now the teachers are loving it.

Thanks,

-- 
# TRS-80  trs80(a)ucc.gu.uwa.edu.au #/ "Otherwise Bub here will do \
# UCC Wheel Member http://trs80.ucc.asn.au/ #|  what squirrels do best |
[ "There's nobody getting rich writing  ]|  -- Collect and hide your   |
[  software that I know of" -- Bill Gates, 1980 ]\  nuts." -- Acid Reflux #231 /___
AusNOG mailing list
AusNOG@lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog


Re: [AusNOG] 4G Redundancy Device

2020-04-19 Thread James Andrewartha
I recently came across https://www.telcoantennas.com.au/telco-t1 which is 
Cat6 LTE, and based on OpenWRT. $A396 inc GST which is pretty good value 
IMHO, including a passive PoE power supply. Telco Antennas have developed 
it themselves and pushed their changes upstream 
https://github.com/openwrt/packages/search?q=telcoantennas.com.au_q=telcoantennas.com.au=Commits

On Sun, 9 Feb 2020, Roy Adams wrote:

> We are using these in the Philippines.. 435USD
> https://www.hotware.com.tw/en/product-619869/Industry-LTE-Router-for-Internet-service-for-serving-family-SOHO-ATM-bank-and-Bus-
> XLIN-D-series.html
> It is Dual sim, but with only a single Cat6 LTE module, obviously only one 
> SIM active at any time.
> You can pay an additional 200 USD approx for the second Cat6 LTE module for 
> dual-active SIMs, load balancing etc.
> 
> There is a 600-2900 Mhz Dome antenna pictured also for 295 USD - comes with 
> 10m of dual coax with correct connectors at each end
> 
> The problem in Australia will be lack of approval for use on Australian 
> networks and import duties.
> I am guessing that's why the one looking very close to the Hotware one in 
> Australia is around 950 AUD.
> https://comset.com.au/4g-lte-modem-routers-c-65/dual-sim-dual-band-4port-gigabit-router-cm510qw-p-286.html
> 
> Both of the above look strangely similar and features are identical.
> 
> 
> Kindly,
> 
> ROY ADAMS | P 07 3040 5010  | Web: http://www.racs.com.au/ | Wiki: 
> https://ex.racs.com.au:444/ | eMail: mailto:r...@racs.com.au
> Please never upgrade to the latest Windows 10 - You don’t need the hassle, 
> and I don’t need the work.
> More seriously, the 6 months older Windows 10 releases are typically FAR MORE 
> stable - a simple RACS script can fix this - just
> ask :)
> If you think it's expensive to hire a professional to do the job, wait until 
> you hire an amateur - Red Adair.
> Life is a journey through a series of adventures... Live them, love them, 
> hate them, but never give up on your dreams, desires,
> and goals.
> Have you been good today? .ಠ_ಠ
> 
> 
> On Sat, 8 Feb 2020 at 20:28, Brad Peczka  wrote:
>   Cradlepoint have some good offerings in this space - the 
> CBA850-1200M-B-AP and AER2200 are both rated for 1.2Gbps
>   via LTE Advanced Pro.
> 
>   Regards,
>   -Brad.
> 
>   -Original Message-
>   From: AusNOG  On Behalf Of James 
> Andrewartha
>   Sent: Friday, 7 February 2020 6:24 PM
>   To: Mark Dignam 
>   Cc: ausnog@lists.ausnog.net
>   Subject: Re: [AusNOG] 4G Redundancy Device
> 
>   Most of these have LTE Cat 4 modems, ie 150Mpbs down/50Mbps up 
> theoretical. I'm still on the lookout for a
>   standalone one that's Cat 6 or better. Well, there is the Netgear 
> Nighthawk M1/M2 but it's more of a consumer device
>   than one suited for infrastructure use.
> 
>   We're using Fortigates at the moment so I picked up some Fortigate 
> 30E-3G4Gs which have a Sierra Wireless EM7565
>   modem that's Cat 12, so 600/100Mbps theoretical. One will be replacing 
> a LB2120 which has been functioning fine.
> 
>   On Thu, 6 Feb 2020, Mark Dignam wrote:
> 
>   > The LB2120 is a rather cool piece of kit – we have deployed some as
>   > backups for a few clients, or prime for others with no FTTN.. Only
>   > real gotcha I’ve found is the external antenna connectors aren’t 
> exactly robust… which led me to the other gadget
>   I’ve found useful…….
>   >
>   >  
>   >
>   > A https://teltonika-networks.com/product/rut240/ which is basicly an
>   > industrial version of a OpenWRT box.. with SMA instead of
>   > TS9 sockets.
>   >
>   >  
>   >
>   >  
>   >
>   > From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of
>   > Nathan Brookfield
>   > Sent: Thursday, 6 February 2020 10:51 AM
>   > To: Graham Maltby ; ausnog@lists.ausnog.net
>   > Subject: Re: [AusNOG] 4G Redundancy Device
>   >
>   >  
>   >
>   > Love them, use them connected to Microtik’s for OPVPN clients, great
>   > devices and they don’t’ get hot and overheat like the Sierra dongles 
> haha.
>   >
>   >  
>   >
>   > Kindest Regards,
>   >
>   >  
>   >
>   > Nathan Brookfield (VK2NAB)
>   >
>   > Simtronic Technologies Pty Ltd
>   >
>   >  
>   >
>   > Local: (02) 4749 4949 | Fax: (02) 4749 4950 | Direct: (02) 4749 4951
>   >
>   > Web: http://www.simtronic.com.au | E-mail: 
>   > nathan.brookfi...@simtronic.com.au
>   >
>   >
>   > CONFIDENTIALITY & PRIVILEGE NOTICE
>   >
>   > The information contained in this email and any attached files is
>   > strictly private and confidential. The intended recipient of this
>   > email may only use, reproduce, disclose or distribute the information
>   > contained in this email and any attached files with Simtronic
>   > Technologies Pty 

Re: [AusNOG] My condolences to the people trying to sort out remote learning

2020-04-19 Thread Dave Taht
On Sun, Apr 19, 2020 at 5:57 PM Karl Auer  wrote:
>
> On Sun, 2020-04-19 at 17:16 -0700, Dave Taht wrote:
> > It really bugs me that a soiree with me and a couple friends
> > has to be on a server in the cloud, webrtc is pretty amazingly low
> > bandwidth.
>
> The problem is and always has been NAT. You need an external rendezvous
> point OR complicated port forwarding arrangements set up in advance. An
> external server neatly solves those issues.
>
> At least things like Jitsi let you set up your own server eg in AWS.

https://jitsi.org/blog/e2ee/

>
> Regards, K.
>
> --
> ~~~
> Karl Auer (ka...@biplane.com.au)
> http://www.biplane.com.au/kauer
> http://twitter.com/kauer389
>
> GPG fingerprint: 2561 E9EC D868 E73C 8AF1 49CF EE50 4B1D CCA1 5170
> Old fingerprint: 8D08 9CAA 649A AFEF E862 062A 2E97 42D4 A2A0 616D
>
>
> ___
> AusNOG mailing list
> AusNOG@lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog



-- 
Make Music, Not War

Dave Täht
CTO, TekLibre, LLC
http://www.teklibre.com
Tel: 1-831-435-0729
___
AusNOG mailing list
AusNOG@lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog


Re: [AusNOG] My condolences to the people trying to sort out remote learning

2020-04-19 Thread Karl Auer
On Sun, 2020-04-19 at 17:16 -0700, Dave Taht wrote:
> It really bugs me that a soiree with me and a couple friends
> has to be on a server in the cloud, webrtc is pretty amazingly low
> bandwidth.

The problem is and always has been NAT. You need an external rendezvous
point OR complicated port forwarding arrangements set up in advance. An
external server neatly solves those issues.

At least things like Jitsi let you set up your own server eg in AWS.

Regards, K.

-- 
~~~
Karl Auer (ka...@biplane.com.au)
http://www.biplane.com.au/kauer
http://twitter.com/kauer389

GPG fingerprint: 2561 E9EC D868 E73C 8AF1 49CF EE50 4B1D CCA1 5170
Old fingerprint: 8D08 9CAA 649A AFEF E862 062A 2E97 42D4 A2A0 616D


___
AusNOG mailing list
AusNOG@lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog


Re: [AusNOG] My condolences to the people trying to sort out remote learning

2020-04-19 Thread Dave Taht
On Sun, Apr 19, 2020 at 5:10 PM Bill Woodcock  wrote:
>
> FWIW, I’ve been looking at a lot of the options, and I know a lot of other 
> people who have as well, for various school districts and universities, and 
> the best option (mainly from a 
> not-exposing-children-to-malware-and-naked-Nazi-zoombombers perspective) is 
> BigBlueButton.  It’s open-source, well-supported, and runs entirely sandboxed 
> in the browser, HTML5, like Jitsi, but with an online-classroom focus rather 
> than a business-meeting focus.
>
> https://github.com/bigbluebutton/bigbluebutton
>
> That said, I’m not trying to use it in production myself.  Friends who are 
> say it’s mostly great, but the audio quality isn’t as good as some of the 
> commercial options.  Which isn’t surprising.  Audio noise cancellation is the 
> subject of a million patents, and patent-trolls.

lwn.net has two articles up so far:

jitsi: https://lwn.net/Articles/815751/

BBB:
https://lwn.net/SubscriberLink/817146/ab4cf6e655ed8333/

I have been fiddling with meetecho "janus", and "sylkserver". There's
also a pretty good go library https://github.com/pion/webrtc

It really bugs me that a soiree with me and a couple friends
has to be on a server in the cloud, webrtc is pretty amazingly low bandwidth.

> > On Apr 20, 2020, at 2:03 AM, Rob Thomas  wrote:
> >
> > I'm watching my wife and her friends on derpbook try to consolidate
> > their tech support hints and tips to get the rugrats onto and into Day
> > 1 of their remote learning, and the last thing she sent to me was
> > 'High school has fully crashed'.
> >
> > I understand that all your stuff is on fire, and everything that was
> > on fire yesterday is now a towering inferno, and you probably feel
> > like everyone is blaming you.
> >
> > Please don't stress. If you have someone breathing down your neck,
> > here's a bunch of technically correct, but also useless excuses you
> > can give people to get them off your back for a while, while you
> > actually fix the problems that have cropped up without having to
> > explain them to a non-technical audience.
> >
> > 1. There are IPv6 problems (you can grow this one out as much as you
> > want. Blame NAT64)
> > 2. We aren't receiving all of AARNET's BGP announcements (bonus points
> > are awarded if you're not MEANT to be receiving AARNET's BGP
> > announcements, but still manage to use this as an excuse)
> > 3. Some of our peering links are down (Well, you can't use that if you
> > REALLY have all your peering links up, but who is in that state right
> > now??)
> > 4. Office365 is playing up _or_ Office365 has just started working
> > (You can alternate this one, to match reality)
> > 5. There's congestion on the Telstra network (Don't be specific as to
> > WHERE the congestion is)
> > 6. Have you checked YOUR firewall? No, really. Check it again. (Repeat
> > several times)
> > 7. Wildcard! Blame VoIP.  SIP is so complex, most people will glaze
> > over when you start explaining that the SDP is being mangled
> > incorrectly so RTP is leaving bogus port forwarding in place in your
> > border NAT device which ... blah blah.
> >
> > But here's the important thing.  This is not the end of the world. If
> > stuff is down because of something out of your control, or because
> > you're busy putting out other fires, IT DOESN'T MATTER. Here's a photo
> > of my pair not CARING that everything is broken.
> >
> > https://i.imgur.com/jBXrE9M.png
> >
> > They're the end users, they don't care. No matter who is saying it's a
> > life and death thing, it's not. There ARE things that are life and
> > death (eg, 000/VoIP!). Care about those.
> >
> > And geez, if you REALLY get stuck with something that you think that
> > you should be able to figure out and can't, post it here. We don't
> > mind. Got a VOIP problem? Ask me here, or off list. BGP Filters not
> > working? Routing loops? Whatever. Post it here. (Except, possibly
> > enough of the 'Office 365 CDN is corrupt' stuff, because this is
> > something that Microsoft REALLY SHOULD have solved by now)
> >
> > I always find that even just talking about, or writing down, a problem
> > that has stumped me always helps (see 'Rubber Duck Debugging'). Half
> > of us are sitting around twiddling our thumbs because we've got 50% of
> > our normal traffic, and I'm sure we'll all be willing to help.
> >
> > --Rob
> >
> > PS: I honestly, truly, care. I've been RIGHT at the end of my tether
> > for stupid reasons and because I was under insane pressure. You,
> > personally, are more important than your job. Don't kill yourself
> > (metaphorically OR literally).  Wanna chat about shit? Call me.
> > 0402-077-155. Anytime.
> > ___
> > AusNOG mailing list
> > AusNOG@lists.ausnog.net
> > http://lists.ausnog.net/mailman/listinfo/ausnog
>
>
> -Bill
>
> ___
> AusNOG mailing list
> AusNOG@lists.ausnog.net
> 

Re: [AusNOG] My condolences to the people trying to sort out remote learning

2020-04-19 Thread Bill Woodcock
FWIW, I’ve been looking at a lot of the options, and I know a lot of other 
people who have as well, for various school districts and universities, and the 
best option (mainly from a 
not-exposing-children-to-malware-and-naked-Nazi-zoombombers perspective) is 
BigBlueButton.  It’s open-source, well-supported, and runs entirely sandboxed 
in the browser, HTML5, like Jitsi, but with an online-classroom focus rather 
than a business-meeting focus.

https://github.com/bigbluebutton/bigbluebutton

That said, I’m not trying to use it in production myself.  Friends who are say 
it’s mostly great, but the audio quality isn’t as good as some of the 
commercial options.  Which isn’t surprising.  Audio noise cancellation is the 
subject of a million patents, and patent-trolls.

> On Apr 20, 2020, at 2:03 AM, Rob Thomas  wrote:
> 
> I'm watching my wife and her friends on derpbook try to consolidate
> their tech support hints and tips to get the rugrats onto and into Day
> 1 of their remote learning, and the last thing she sent to me was
> 'High school has fully crashed'.
> 
> I understand that all your stuff is on fire, and everything that was
> on fire yesterday is now a towering inferno, and you probably feel
> like everyone is blaming you.
> 
> Please don't stress. If you have someone breathing down your neck,
> here's a bunch of technically correct, but also useless excuses you
> can give people to get them off your back for a while, while you
> actually fix the problems that have cropped up without having to
> explain them to a non-technical audience.
> 
> 1. There are IPv6 problems (you can grow this one out as much as you
> want. Blame NAT64)
> 2. We aren't receiving all of AARNET's BGP announcements (bonus points
> are awarded if you're not MEANT to be receiving AARNET's BGP
> announcements, but still manage to use this as an excuse)
> 3. Some of our peering links are down (Well, you can't use that if you
> REALLY have all your peering links up, but who is in that state right
> now??)
> 4. Office365 is playing up _or_ Office365 has just started working
> (You can alternate this one, to match reality)
> 5. There's congestion on the Telstra network (Don't be specific as to
> WHERE the congestion is)
> 6. Have you checked YOUR firewall? No, really. Check it again. (Repeat
> several times)
> 7. Wildcard! Blame VoIP.  SIP is so complex, most people will glaze
> over when you start explaining that the SDP is being mangled
> incorrectly so RTP is leaving bogus port forwarding in place in your
> border NAT device which ... blah blah.
> 
> But here's the important thing.  This is not the end of the world. If
> stuff is down because of something out of your control, or because
> you're busy putting out other fires, IT DOESN'T MATTER. Here's a photo
> of my pair not CARING that everything is broken.
> 
> https://i.imgur.com/jBXrE9M.png
> 
> They're the end users, they don't care. No matter who is saying it's a
> life and death thing, it's not. There ARE things that are life and
> death (eg, 000/VoIP!). Care about those.
> 
> And geez, if you REALLY get stuck with something that you think that
> you should be able to figure out and can't, post it here. We don't
> mind. Got a VOIP problem? Ask me here, or off list. BGP Filters not
> working? Routing loops? Whatever. Post it here. (Except, possibly
> enough of the 'Office 365 CDN is corrupt' stuff, because this is
> something that Microsoft REALLY SHOULD have solved by now)
> 
> I always find that even just talking about, or writing down, a problem
> that has stumped me always helps (see 'Rubber Duck Debugging'). Half
> of us are sitting around twiddling our thumbs because we've got 50% of
> our normal traffic, and I'm sure we'll all be willing to help.
> 
> --Rob
> 
> PS: I honestly, truly, care. I've been RIGHT at the end of my tether
> for stupid reasons and because I was under insane pressure. You,
> personally, are more important than your job. Don't kill yourself
> (metaphorically OR literally).  Wanna chat about shit? Call me.
> 0402-077-155. Anytime.
> ___
> AusNOG mailing list
> AusNOG@lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog


-Bill



signature.asc
Description: Message signed with OpenPGP
___
AusNOG mailing list
AusNOG@lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog


Re: [AusNOG] My condolences to the people trying to sort out remote learning

2020-04-19 Thread Dave Taht
On Sun, Apr 19, 2020 at 5:04 PM Rob Thomas  wrote:
>
> I'm watching my wife and her friends on derpbook try to consolidate
> their tech support hints and tips to get the rugrats onto and into Day
> 1 of their remote learning, and the last thing she sent to me was
> 'High school has fully crashed'.
>
> I understand that all your stuff is on fire, and everything that was
> on fire yesterday is now a towering inferno, and you probably feel
> like everyone is blaming you.
>
> Please don't stress. If you have someone breathing down your neck,
> here's a bunch of technically correct, but also useless excuses you
> can give people to get them off your back for a while, while you
> actually fix the problems that have cropped up without having to
> explain them to a non-technical audience.
>
> 1. There are IPv6 problems (you can grow this one out as much as you
> want. Blame NAT64)
> 2. We aren't receiving all of AARNET's BGP announcements (bonus points
> are awarded if you're not MEANT to be receiving AARNET's BGP
> announcements, but still manage to use this as an excuse)
> 3. Some of our peering links are down (Well, you can't use that if you
> REALLY have all your peering links up, but who is in that state right
> now??)
> 4. Office365 is playing up _or_ Office365 has just started working
> (You can alternate this one, to match reality)
> 5. There's congestion on the Telstra network (Don't be specific as to
> WHERE the congestion is)
> 6. Have you checked YOUR firewall? No, really. Check it again. (Repeat
> several times)
> 7. Wildcard! Blame VoIP.  SIP is so complex, most people will glaze
> over when you start explaining that the SDP is being mangled
> incorrectly so RTP is leaving bogus port forwarding in place in your
> border NAT device which ... blah blah.

8. Bufferbloat!

> But here's the important thing.  This is not the end of the world. If
> stuff is down because of something out of your control, or because
> you're busy putting out other fires, IT DOESN'T MATTER. Here's a photo
> of my pair not CARING that everything is broken.
>
> https://i.imgur.com/jBXrE9M.png
>
> They're the end users, they don't care. No matter who is saying it's a
> life and death thing, it's not. There ARE things that are life and
> death (eg, 000/VoIP!). Care about those.
>
> And geez, if you REALLY get stuck with something that you think that
> you should be able to figure out and can't, post it here. We don't
> mind. Got a VOIP problem? Ask me here, or off list. BGP Filters not
> working? Routing loops? Whatever. Post it here. (Except, possibly
> enough of the 'Office 365 CDN is corrupt' stuff, because this is
> something that Microsoft REALLY SHOULD have solved by now)
>
> I always find that even just talking about, or writing down, a problem
> that has stumped me always helps (see 'Rubber Duck Debugging'). Half
> of us are sitting around twiddling our thumbs because we've got 50% of
> our normal traffic, and I'm sure we'll all be willing to help.
>
> --Rob
>
> PS: I honestly, truly, care. I've been RIGHT at the end of my tether
> for stupid reasons and because I was under insane pressure. You,
> personally, are more important than your job. Don't kill yourself
> (metaphorically OR literally).  Wanna chat about shit? Call me.
> 0402-077-155. Anytime.
> ___
> AusNOG mailing list
> AusNOG@lists.ausnog.net
> http://lists.ausnog.net/mailman/listinfo/ausnog



-- 
Make Music, Not War

Dave Täht
CTO, TekLibre, LLC
http://www.teklibre.com
Tel: 1-831-435-0729
___
AusNOG mailing list
AusNOG@lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog


[AusNOG] My condolences to the people trying to sort out remote learning

2020-04-19 Thread Rob Thomas
I'm watching my wife and her friends on derpbook try to consolidate
their tech support hints and tips to get the rugrats onto and into Day
1 of their remote learning, and the last thing she sent to me was
'High school has fully crashed'.

I understand that all your stuff is on fire, and everything that was
on fire yesterday is now a towering inferno, and you probably feel
like everyone is blaming you.

Please don't stress. If you have someone breathing down your neck,
here's a bunch of technically correct, but also useless excuses you
can give people to get them off your back for a while, while you
actually fix the problems that have cropped up without having to
explain them to a non-technical audience.

1. There are IPv6 problems (you can grow this one out as much as you
want. Blame NAT64)
2. We aren't receiving all of AARNET's BGP announcements (bonus points
are awarded if you're not MEANT to be receiving AARNET's BGP
announcements, but still manage to use this as an excuse)
3. Some of our peering links are down (Well, you can't use that if you
REALLY have all your peering links up, but who is in that state right
now??)
4. Office365 is playing up _or_ Office365 has just started working
(You can alternate this one, to match reality)
5. There's congestion on the Telstra network (Don't be specific as to
WHERE the congestion is)
6. Have you checked YOUR firewall? No, really. Check it again. (Repeat
several times)
7. Wildcard! Blame VoIP.  SIP is so complex, most people will glaze
over when you start explaining that the SDP is being mangled
incorrectly so RTP is leaving bogus port forwarding in place in your
border NAT device which ... blah blah.

But here's the important thing.  This is not the end of the world. If
stuff is down because of something out of your control, or because
you're busy putting out other fires, IT DOESN'T MATTER. Here's a photo
of my pair not CARING that everything is broken.

https://i.imgur.com/jBXrE9M.png

They're the end users, they don't care. No matter who is saying it's a
life and death thing, it's not. There ARE things that are life and
death (eg, 000/VoIP!). Care about those.

And geez, if you REALLY get stuck with something that you think that
you should be able to figure out and can't, post it here. We don't
mind. Got a VOIP problem? Ask me here, or off list. BGP Filters not
working? Routing loops? Whatever. Post it here. (Except, possibly
enough of the 'Office 365 CDN is corrupt' stuff, because this is
something that Microsoft REALLY SHOULD have solved by now)

I always find that even just talking about, or writing down, a problem
that has stumped me always helps (see 'Rubber Duck Debugging'). Half
of us are sitting around twiddling our thumbs because we've got 50% of
our normal traffic, and I'm sure we'll all be willing to help.

--Rob

PS: I honestly, truly, care. I've been RIGHT at the end of my tether
for stupid reasons and because I was under insane pressure. You,
personally, are more important than your job. Don't kill yourself
(metaphorically OR literally).  Wanna chat about shit? Call me.
0402-077-155. Anytime.
___
AusNOG mailing list
AusNOG@lists.ausnog.net
http://lists.ausnog.net/mailman/listinfo/ausnog


Re: [AusNOG] Vocus Office 365 CDN corrupt again

2020-04-19 Thread Phil Mawson
Hi,

I have flagged this again with the content providers.

Cheers,
Phil

> On 18 Apr 2020, at 8:31 pm, Samuel D. Leslie  wrote:
> 
> Hi James,
> 
> I've been put in touch with some Akamai and Vocus engineers but as of yet no 
> progress appears to have been made. If/when that changes I'll update this 
> thread. I've replied to you off-list w.r.t. your other questions.
> 
> 
> Cheers,
> -SDL
> 
> -Original Message-
> From: James Andrewartha  
> Sent: Friday, 17 April 2020 6:42 PM
> To: Samuel D. Leslie ; Phil Mawson 
> Cc: ausnog@lists.ausnog.net
> Subject: Re: [AusNOG] Vocus Office 365 CDN corrupt again
> 
> Hi Phil,
> 
> Akamai is now giving us Vocus Akamai servers, and they are giving us a bad 
> file too - 139.218.20.187 has an md5sum of
> 4f93c7595d3965dc836e6b0eb7b06c05 for stream.x64.x-none.dat
> 
> Thanks,
> 
> -- 
> # TRS-80  trs80(a)ucc.gu.uwa.edu.au #/ "Otherwise Bub here will 
> do \
> # UCC Wheel Member 
> https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ftrs80.ucc.asn.au%2Fdata=02%7C01%7C%7C0c32741b173e4501f4d208d7e2ab23d1%7C3deb19d522704bec8e4d912c52be1b9d%7C0%7C0%7C637227096997619312sdata=cKbr2SMjdlrZ5OWPogV84sjE3rxcgv%2FO3a1vvfe879c%3Dreserved=0
>  #|  what squirrels do best |
> [ "There's nobody getting rich writing  ]|  -- Collect and hide your  
>  |
> [  software that I know of" -- Bill Gates, 1980 ]\  nuts." -- Acid Reflux 
> #231 /
> 
> 
> On Fri, 17 Apr 2020, James Andrewartha wrote:
> 
>> Oddly I switched to direct DNS and got switched to Akamai WAIX, but I 
>> get a different MD5sum again, f4a4e53bd2869971c342a06881e445bc from
>> 
>> officecdn.microsoft.com.edgesuite.net is an alias for 
>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net.
>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net is an 
>> alias for a1737.dspw65.akamai.net.
>> a1737.dspw65.akamai.net is an alias for 
>> a1737.dspw65.akamai.net.0.1.cn.akamaitech.net.
>> a1737.dspw65.akamai.net.0.1.cn.akamaitech.net has address 
>> 23.192.239.161 a1737.dspw65.akamai.net.0.1.cn.akamaitech.net has 
>> address 23.192.239.169 a1737.dspw65.akamai.net.0.1.cn.akamaitech.net 
>> has IPv6 address 2600:1415:b800::1737:de0b 
>> a1737.dspw65.akamai.net.0.1.cn.akamaitech.net has IPv6 address 
>> 2600:1415:b800::1737:de0a
>> 
>> Setting my DNS forwarder to 1.1.1.1 and I connect to 184.86.223.8 and 
>> now the install works, md5sum is b091593c99575c9f9c1f970d23cf4cc2
>> 
>> So that's 4 different hashes from 4 different Akamai mirrors. Well I 
>> tested again and 184.86.223.32 gives me 
>> b091593c99575c9f9c1f970d23cf4cc2 too, so 4 different from 5.
>> 
>> -- 
>> # TRS-80  trs80(a)ucc.gu.uwa.edu.au #/ "Otherwise Bub here will 
>> do \
>> # UCC Wheel Member 
>> https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ftrs80.ucc.asn.au%2Fdata=02%7C01%7C%7C0c32741b173e4501f4d208d7e2ab23d1%7C3deb19d522704bec8e4d912c52be1b9d%7C0%7C0%7C637227096997619312sdata=cKbr2SMjdlrZ5OWPogV84sjE3rxcgv%2FO3a1vvfe879c%3Dreserved=0
>>  #|  what squirrels do best |
>> [ "There's nobody getting rich writing  ]|  -- Collect and hide your 
>>   |
>> [  software that I know of" -- Bill Gates, 1980 ]\  nuts." -- Acid 
>> Reflux #231 /
>> 
>> On Fri, 17 Apr 2020, James Andrewartha wrote:
>> 
>>> Hi Samuel,
>>> 
>>> Where did you find the logfile with the error? We're having problems 
>>> installing Office 365 yesterday and today, the client seems to be 
>>> downloading
>>> https://aus01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foff
>>> icecdn.microsoft.com.edgesuite.net%2Fpr%2F7ffbc6bf-bc32-4f92-8982-f9
>>> dd17fd3114%2FOffice%2FData%2F16.0.11929.20708%2Fstream.x64.x-none.da
>>> tdata=02%7C01%7C%7C0c32741b173e4501f4d208d7e2ab23d1%7C3deb19d52
>>> 2704bec8e4d912c52be1b9d%7C0%7C0%7C637227096997619312sdata=s79uZ
>>> A%2Fz47jlwA3Qx8vjk7YskEJpHd%2FprqhZUvizCA4%3Dreserved=0
>>> which is coming from the AARNet mirror and has an md5sum of
>>> 82ba6ca2947f30ea7130370caf45b066
>>> 
>>> officecdn.microsoft.com.edgesuite.net is an alias for 
>>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net.
>>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net is an 
>>> alias for a1737.dspw65.akamai.net.
>>> a1737.dspw65.akamai.net has address 203.13.161.144 
>>> a1737.dspw65.akamai.net has address 203.13.161.138 
>>> a1737.dspw65.akamai.net has IPv6 address 2001:388:1:180d::cb0d:a190 
>>> a1737.dspw65.akamai.net has IPv6 address 2001:388:1:180d::cb0d:a18a
>>> 
>>> The install gets stuck at 51%, even overnight. Just tested by 
>>> pointing my DNS at 1.1.1.1 and downloading from this host:
>>> 
>>> officecdn.microsoft.com.edgesuite.net is an alias for 
>>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net.
>>> officecdn.microsoft.com.edgesuite.net.globalredir.akadns.net is an 
>>> alias for a1737.dspw65.akamai.net.
>>> a1737.dspw65.akamai.net has address 23.53.241.83 
>>> a1737.dspw65.akamai.net has address 23.53.241.67 
>>>