Re: External BGP Controller for L3 Switch BGP routing

[Yucong Sun]

In my setup, I use an BIRD instance to combine multiple internet full
tables,  i use some filter to generate some override route to send to my L3
switch to do routing.  The L3 switch is configured with the default route
to the main transit provider , if BIRD is down, the route would be
unoptimized, but everything else remain operable until i fixed that BIRD
instance.

I've asked around about why there isn't a L3 switch capable of handling
full tables, I really don't understand the difference/logic behind it.

On Sun, Jan 15, 2017 at 10:43 PM Tore Anderson  wrote:

> Hi Saku,
>
> > >
> https://www.redpill-linpro.com/sysadvent/2016/12/09/slimming-routing-table.html
> >
> > ---
> > As described in a prevous post, we’re testing a HPE Altoline 6920 in
> > our lab. The Altoline 6920 is, like other switches based on the
> > Broadcom Trident II chipset, able to handle up to 720 Gbps of
> > throughput, packing 48x10GbE + 6x40GbE ports in a compact 1RU chassis.
> > Its price is in all likelihood a single-digit percentage of the price
> > of a traditional Internet router with a comparable throughput rating.
> > ---
> >
> > This makes it sound like small-FIB router is single-digit percentage
> > cost of full-FIB.
>
> Do you know of any traditional «Internet scale» router that can do ~720
> Gbps of throughput for less than 10x the price of a Trident II box? Or
> even <100kUSD? (Disregarding any volume discounts.)
>
> > Also having Trident in Internet facing interface may be suspect,
> > especially if you need to go from fast interface to slow or busy
> > interface, due to very minor packet buffers. This obviously won't be
> > much of a problem in inside-DC traffic.
>
> Quite the opposite, changing between different interface speeds happens
> very commonly inside the data centre (and most of the time it's done by
> shallow-buffered switches using Trident II or similar chips).
>
> One ubiquitous configuration has the servers and any external uplinks
> attached with 10GE to leaf switches which in turn connects to a 40GE
> spine layer with. In this config server<->server and server<->Internet
> packets will need to change speed twice:
>
> [server]-10GE-(leafX)-40GE-(spine)-40GE-(leafY)-10GE-[server/internet]
>
> I suppose you could for example use a couple of MX240s or something as
> a special-purpose leaf layer for external connectivity.
> MPC5E-40G10G-IRB or something towards the 40GE spines and any regular
> 10GE MPC towards the exits. That way you'd only have one
> shallow-buffered speed conversion remaining. But I'm very sceptical if
> something like this makes sense after taking the cost/benefit ratio
> into account.
>
> Tore
>

Re: External BGP Controller for L3 Switch BGP routing

[Tore Anderson]

Hi Saku,

> > https://www.redpill-linpro.com/sysadvent/2016/12/09/slimming-routing-table.html
> 
> ---
> As described in a prevous post, we’re testing a HPE Altoline 6920 in
> our lab. The Altoline 6920 is, like other switches based on the
> Broadcom Trident II chipset, able to handle up to 720 Gbps of
> throughput, packing 48x10GbE + 6x40GbE ports in a compact 1RU chassis.
> Its price is in all likelihood a single-digit percentage of the price
> of a traditional Internet router with a comparable throughput rating.
> ---
> 
> This makes it sound like small-FIB router is single-digit percentage
> cost of full-FIB.

Do you know of any traditional «Internet scale» router that can do ~720
Gbps of throughput for less than 10x the price of a Trident II box? Or
even <100kUSD? (Disregarding any volume discounts.)

> Also having Trident in Internet facing interface may be suspect,
> especially if you need to go from fast interface to slow or busy
> interface, due to very minor packet buffers. This obviously won't be
> much of a problem in inside-DC traffic.

Quite the opposite, changing between different interface speeds happens
very commonly inside the data centre (and most of the time it's done by
shallow-buffered switches using Trident II or similar chips).

One ubiquitous configuration has the servers and any external uplinks
attached with 10GE to leaf switches which in turn connects to a 40GE
spine layer with. In this config server<->server and server<->Internet
packets will need to change speed twice:

[server]-10GE-(leafX)-40GE-(spine)-40GE-(leafY)-10GE-[server/internet]

I suppose you could for example use a couple of MX240s or something as
a special-purpose leaf layer for external connectivity.
MPC5E-40G10G-IRB or something towards the 40GE spines and any regular
10GE MPC towards the exits. That way you'd only have one
shallow-buffered speed conversion remaining. But I'm very sceptical if
something like this makes sense after taking the cost/benefit ratio
into account.

Tore

Re: St. Louis IX Launch

[Mike Hammett]

It is a partnership and I may not be the most qualified to speak on the terms 
of the partnership. However, the non-commercial side is not-for-profit, but the 
commercial side is fully commercial. 

While building out our IX brand, of those that have been able to have a 
rational discussion about their anti-commercial IX position, almost all of them 
(or maybe even all of them) weren't really anti-commercial. They were just 
anti-800-lb-gorilla. They didn't hate the independent building out IXes in 
markets that maybe never had a functional IX, but surely didn't have one now. 
They hated Equinix, Coresite, etc. They just wanted someone that wasn't going 
to be a jerk to them. 

We don't have any aspirations to get to Equinix size. We know we're going to 
small time places and that we'll only ever have small time IXes in the big 
picture. The building we started at in Indy only advertises something like 20 
or 30 networks in the building. Now we've grown to other buildings and they 
aren't going to list every Tom, Dick and Harry, but it's not a 300 network 
market. We'll leave that to AMS-IX, DE-CIX, Megaport, etc. 




- 
Mike Hammett 
Intelligent Computing Solutions 

Midwest Internet Exchange 

The Brothers WISP 

- Original Message -

From: "Ken Chase"  
To: "NANOG ???[nanog@nanog.org]???"  
Sent: Sunday, January 15, 2017 6:36:20 PM 
Subject: Re: St. Louis IX Launch 

congrats! 

I am curious, is the IX non-for-profit as well? The wikipedia entry for IX's 
doenst indicate which IX's are non-profit. Im curious as to the prevalence 
and size (as well as the relative successes) of such IX's vs for profit models 
(equinix etc). 

/kc 


On Sun, Jan 15, 2017 at 06:30:45PM -0600, Mike Hammett said: 
>If you know someone that may be interested, we have a launch event later this 
>week for our St. Louis IX. St. Louis is a bit different than our existing 
>market in that we've partnered with a local non-profit that will be focusing 
>on non-commercial Internet aspects. These sorts of things are innovation 
>neighborhoods, IoT, healthcare, education, public safety, etc. They may (or 
>may not) be the big volume things we're used to, but they need local, 
>low-latency connectivity just as much. 
> 
>https://www.eventbrite.com/e/st-louis-regional-internet-exchange-preview-tickets-30329718003?aff=NANOG
> 
> 
> 
> 
> 
>- 
>Mike Hammett 
>Intelligent Computing Solutions 
> 
>Midwest Internet Exchange 
> 
>The Brothers WISP 
> 

-- 
Ken Chase - k...@heavycomputing.ca skype:kenchase23 +1 416 897 6284 Toronto 
Canada 
Heavy Computing - Clued bandwidth, colocation and managed linux VPS @151 Front 
St. W. 

Re: St. Louis IX Launch

[Kaiser, Erich]

To bad such short notice...

:(  I am going to be out of town, would have been nice to be able to go...

Erich Kaiser
The Fusion Network
er...@gotfusion.net
Office: 630-621-4804
Cell: 630-777-9291



On Sun, Jan 15, 2017 at 6:30 PM, Mike Hammett  wrote:

> If you know someone that may be interested, we have a launch event later
> this week for our St. Louis IX. St. Louis is a bit different than our
> existing market in that we've partnered with a local non-profit that will
> be focusing on non-commercial Internet aspects. These sorts of things are
> innovation neighborhoods, IoT, healthcare, education, public safety, etc.
> They may (or may not) be the big volume things we're used to, but they need
> local, low-latency connectivity just as much.
>
> https://www.eventbrite.com/e/st-louis-regional-internet-
> exchange-preview-tickets-30329718003?aff=NANOG
>
>
>
>
> -
> Mike Hammett
> Intelligent Computing Solutions
>
> Midwest Internet Exchange
>
> The Brothers WISP
>
>

Re: St. Louis IX Launch

[Ken Chase]

congrats!

I am curious, is the IX non-for-profit as well? The wikipedia entry for IX's
doenst indicate which IX's are non-profit. Im curious as to the prevalence
and size (as well as the relative successes) of such IX's vs for profit models 
(equinix etc).

/kc


On Sun, Jan 15, 2017 at 06:30:45PM -0600, Mike Hammett said:
  >If you know someone that may be interested, we have a launch event later 
this week for our St. Louis IX. St. Louis is a bit different than our existing 
market in that we've partnered with a local non-profit that will be focusing on 
non-commercial Internet aspects. These sorts of things are innovation 
neighborhoods, IoT, healthcare, education, public safety, etc. They may (or may 
not) be the big volume things we're used to, but they need local, low-latency 
connectivity just as much. 
  >
  
>https://www.eventbrite.com/e/st-louis-regional-internet-exchange-preview-tickets-30329718003?aff=NANOG
 
  >
  >
  >
  >
  >- 
  >Mike Hammett 
  >Intelligent Computing Solutions 
  >
  >Midwest Internet Exchange 
  >
  >The Brothers WISP 
  >

-- 
Ken Chase - k...@heavycomputing.ca skype:kenchase23 +1 416 897 6284 Toronto 
Canada
Heavy Computing - Clued bandwidth, colocation and managed linux VPS @151 Front 
St. W.

St. Louis IX Launch

[Mike Hammett]

If you know someone that may be interested, we have a launch event later this 
week for our St. Louis IX. St. Louis is a bit different than our existing 
market in that we've partnered with a local non-profit that will be focusing on 
non-commercial Internet aspects. These sorts of things are innovation 
neighborhoods, IoT, healthcare, education, public safety, etc. They may (or may 
not) be the big volume things we're used to, but they need local, low-latency 
connectivity just as much. 

https://www.eventbrite.com/e/st-louis-regional-internet-exchange-preview-tickets-30329718003?aff=NANOG
 




- 
Mike Hammett 
Intelligent Computing Solutions 

Midwest Internet Exchange 

The Brothers WISP