Re: New Switches with Broadcom StrataDNX

2016-04-18 Thread Jeff Tantsura
It depends…

there’s a phenomenon called “next-hop flattening” which has to do with lookup 
recursiveness within the silicon.
Unless this is done (and this is big piece of work) not everything supported on 
Trio or Ezchip can be supported.

In general – Jericho (and its followers) is a great piece of silicon made by 
clueful folks… watch this space closely

Jeff
From:  Colton Conor 
Date:  Monday, April 18, 2016 at 11:44 AM
To:  lincoln dale 
Cc:  Jeff Tantsura , "nanog@nanog.org" 

Subject:  Re: New Switches with Broadcom StrataDNX

So can this compete routing wise against something like a Juniper MX104 or 
Cisco ASR 9001? 

On Mon, Apr 18, 2016 at 1:42 PM, lincoln dale  wrote:
Yes. We also have 1M+ FIB support day one too - hence the letter 'R' denoting 
the evolution with 3rd generation of its evolution to internet edge/router use 
cases.

Not sure what other vendors are doing but I doubt others are yet shipping large 
table support.
(there's more to it than just the underlying native silicon)


cheers,

lincoln. (l...@arista.com)


On Mon, Apr 18, 2016 at 11:01 AM, Colton Conor  wrote:
As a follow up to this post, it look like the Arista 7500R series has this
new chip inside of it.

On Wed, Jan 20, 2016 at 9:34 AM, Jeff Tantsura 
wrote:

> That's right, logic is in programming chips, not their property. You just
> need to know what to program ;-)
>
> Regards,
> Jeff
>
> > On Jan 19, 2016, at 10:10 PM, Mark Tinka  wrote:
> >
> >
> >
> >> On 20/Jan/16 00:17, Phil Bedard wrote:
> >>
> >> Good point, there are many people looking at what I call FIB
> optimization right now.  The key is having the programmability on the
> device to make it happen.  Juniper/Cisco support it using policies to
> filter RIB->FIB and I believe both also do per-NPU/PFE localized FIBs now.
> I am not sure if that’s something supported on this new Broadcom chipset.
> Depends on your network of course and where you are looking to position the
> router.
> >
> > I don't think the FIB needs to have specific support for selective
> > programming.
> >
> > I think that comes in the code to instruct the control plane what it
> > should download to the FIB.
> >
> > Cisco's and Juniper's support of this is on FIB that has been in
> > production long before the feature became available. It was just added
> > to code.
> >
> > Mark.
>





Re: New Switches with Broadcom StrataDNX

2016-04-18 Thread lincoln dale
Yes. We also have 1M+ FIB support day one too - hence the letter 'R'
denoting the evolution with 3rd generation of its evolution to internet
edge/router use cases.

Not sure what other vendors are doing but I doubt others are yet shipping
large table support.
(there's more to it than just the underlying native silicon)


cheers,

lincoln. (l...@arista.com)


On Mon, Apr 18, 2016 at 11:01 AM, Colton Conor 
wrote:

> As a follow up to this post, it look like the Arista 7500R series has this
> new chip inside of it.
>
> On Wed, Jan 20, 2016 at 9:34 AM, Jeff Tantsura  >
> wrote:
>
> > That's right, logic is in programming chips, not their property. You just
> > need to know what to program ;-)
> >
> > Regards,
> > Jeff
> >
> > > On Jan 19, 2016, at 10:10 PM, Mark Tinka  wrote:
> > >
> > >
> > >
> > >> On 20/Jan/16 00:17, Phil Bedard wrote:
> > >>
> > >> Good point, there are many people looking at what I call FIB
> > optimization right now.  The key is having the programmability on the
> > device to make it happen.  Juniper/Cisco support it using policies to
> > filter RIB->FIB and I believe both also do per-NPU/PFE localized FIBs
> now.
> > I am not sure if that’s something supported on this new Broadcom chipset.
> > Depends on your network of course and where you are looking to position
> the
> > router.
> > >
> > > I don't think the FIB needs to have specific support for selective
> > > programming.
> > >
> > > I think that comes in the code to instruct the control plane what it
> > > should download to the FIB.
> > >
> > > Cisco's and Juniper's support of this is on FIB that has been in
> > > production long before the feature became available. It was just added
> > > to code.
> > >
> > > Mark.
> >
>


Re: New Switches with Broadcom StrataDNX

2016-04-18 Thread Jeff Tantsura
Lincoln,

Why wouldn’t they?
What is it Arista did others didn’t?

Cheers,
Jeff

From: lincoln dale mailto:l...@interlink.com.au>>
Date: Monday, April 18, 2016 at 11:42 AM
To: Colton Conor mailto:colton.co...@gmail.com>>
Cc: Jeff Tantsura 
mailto:jeff.tants...@ericsson.com>>, 
"nanog@nanog.org<mailto:nanog@nanog.org>" 
mailto:nanog@nanog.org>>
Subject: Re: New Switches with Broadcom StrataDNX

Yes. We also have 1M+ FIB support day one too - hence the letter 'R' denoting 
the evolution with 3rd generation of its evolution to internet edge/router use 
cases.

Not sure what other vendors are doing but I doubt others are yet shipping large 
table support.
(there's more to it than just the underlying native silicon)


cheers,

lincoln. (l...@arista.com<mailto:l...@arista.com>)


On Mon, Apr 18, 2016 at 11:01 AM, Colton Conor 
mailto:colton.co...@gmail.com>> wrote:
As a follow up to this post, it look like the Arista 7500R series has this
new chip inside of it.

On Wed, Jan 20, 2016 at 9:34 AM, Jeff Tantsura 
mailto:jeff.tants...@ericsson.com>>
wrote:

> That's right, logic is in programming chips, not their property. You just
> need to know what to program ;-)
>
> Regards,
> Jeff
>
> > On Jan 19, 2016, at 10:10 PM, Mark Tinka 
> > mailto:mark.ti...@seacom.mu>> wrote:
> >
> >
> >
> >> On 20/Jan/16 00:17, Phil Bedard wrote:
> >>
> >> Good point, there are many people looking at what I call FIB
> optimization right now.  The key is having the programmability on the
> device to make it happen.  Juniper/Cisco support it using policies to
> filter RIB->FIB and I believe both also do per-NPU/PFE localized FIBs now.
> I am not sure if that’s something supported on this new Broadcom chipset.
> Depends on your network of course and where you are looking to position the
> router.
> >
> > I don't think the FIB needs to have specific support for selective
> > programming.
> >
> > I think that comes in the code to instruct the control plane what it
> > should download to the FIB.
> >
> > Cisco's and Juniper's support of this is on FIB that has been in
> > production long before the feature became available. It was just added
> > to code.
> >
> > Mark.
>



Re: New Switches with Broadcom StrataDNX

2016-04-18 Thread Colton Conor
So can this compete routing wise against something like a Juniper MX104 or
Cisco ASR 9001?

On Mon, Apr 18, 2016 at 1:42 PM, lincoln dale  wrote:

> Yes. We also have 1M+ FIB support day one too - hence the letter 'R'
> denoting the evolution with 3rd generation of its evolution to internet
> edge/router use cases.
>
> Not sure what other vendors are doing but I doubt others are yet shipping
> large table support.
> (there's more to it than just the underlying native silicon)
>
>
> cheers,
>
> lincoln. (l...@arista.com)
>
>
> On Mon, Apr 18, 2016 at 11:01 AM, Colton Conor 
> wrote:
>
>> As a follow up to this post, it look like the Arista 7500R series has this
>> new chip inside of it.
>>
>> On Wed, Jan 20, 2016 at 9:34 AM, Jeff Tantsura <
>> jeff.tants...@ericsson.com>
>> wrote:
>>
>> > That's right, logic is in programming chips, not their property. You
>> just
>> > need to know what to program ;-)
>> >
>> > Regards,
>> > Jeff
>> >
>> > > On Jan 19, 2016, at 10:10 PM, Mark Tinka 
>> wrote:
>> > >
>> > >
>> > >
>> > >> On 20/Jan/16 00:17, Phil Bedard wrote:
>> > >>
>> > >> Good point, there are many people looking at what I call FIB
>> > optimization right now.  The key is having the programmability on the
>> > device to make it happen.  Juniper/Cisco support it using policies to
>> > filter RIB->FIB and I believe both also do per-NPU/PFE localized FIBs
>> now.
>> > I am not sure if that’s something supported on this new Broadcom
>> chipset.
>> > Depends on your network of course and where you are looking to position
>> the
>> > router.
>> > >
>> > > I don't think the FIB needs to have specific support for selective
>> > > programming.
>> > >
>> > > I think that comes in the code to instruct the control plane what it
>> > > should download to the FIB.
>> > >
>> > > Cisco's and Juniper's support of this is on FIB that has been in
>> > > production long before the feature became available. It was just added
>> > > to code.
>> > >
>> > > Mark.
>> >
>>
>
>


Re: New Switches with Broadcom StrataDNX

2016-04-18 Thread Fredrik Korsbäck
On 18/04/16 20:01, Colton Conor wrote:
> As a follow up to this post, it look like the Arista 7500R series has this
> new chip inside of it.
> 
> On Wed, Jan 20, 2016 at 9:34 AM, Jeff Tantsura 
> wrote:
> 
>> That's right, logic is in programming chips, not their property. You just
>> need to know what to program ;-)
>>
>> Regards,
>> Jeff

Not only the big one, The new Arista 7280R is also the new BRCM DNX aka Jericho.

Aswell as Cisco NCS550X series.

-- 
hugge



Re: New Switches with Broadcom StrataDNX

2016-04-18 Thread Colton Conor
As a follow up to this post, it look like the Arista 7500R series has this
new chip inside of it.

On Wed, Jan 20, 2016 at 9:34 AM, Jeff Tantsura 
wrote:

> That's right, logic is in programming chips, not their property. You just
> need to know what to program ;-)
>
> Regards,
> Jeff
>
> > On Jan 19, 2016, at 10:10 PM, Mark Tinka  wrote:
> >
> >
> >
> >> On 20/Jan/16 00:17, Phil Bedard wrote:
> >>
> >> Good point, there are many people looking at what I call FIB
> optimization right now.  The key is having the programmability on the
> device to make it happen.  Juniper/Cisco support it using policies to
> filter RIB->FIB and I believe both also do per-NPU/PFE localized FIBs now.
> I am not sure if that’s something supported on this new Broadcom chipset.
> Depends on your network of course and where you are looking to position the
> router.
> >
> > I don't think the FIB needs to have specific support for selective
> > programming.
> >
> > I think that comes in the code to instruct the control plane what it
> > should download to the FIB.
> >
> > Cisco's and Juniper's support of this is on FIB that has been in
> > production long before the feature became available. It was just added
> > to code.
> >
> > Mark.
>


Re: New Switches with Broadcom StrataDNX

2016-01-20 Thread Jeff Tantsura
That's right, logic is in programming chips, not their property. You just need 
to know what to program ;-)

Regards,
Jeff

> On Jan 19, 2016, at 10:10 PM, Mark Tinka  wrote:
> 
> 
> 
>> On 20/Jan/16 00:17, Phil Bedard wrote:
>> 
>> Good point, there are many people looking at what I call FIB optimization 
>> right now.  The key is having the programmability on the device to make it 
>> happen.  Juniper/Cisco support it using policies to filter RIB->FIB and I 
>> believe both also do per-NPU/PFE localized FIBs now. I am not sure if that’s 
>> something supported on this new Broadcom chipset.  Depends on your network 
>> of course and where you are looking to position the router.
> 
> I don't think the FIB needs to have specific support for selective
> programming.
> 
> I think that comes in the code to instruct the control plane what it
> should download to the FIB.
> 
> Cisco's and Juniper's support of this is on FIB that has been in
> production long before the feature became available. It was just added
> to code.
> 
> Mark.


Re: New Switches with Broadcom StrataDNX

2016-01-19 Thread Mark Tinka


On 20/Jan/16 00:17, Phil Bedard wrote:

> Good point, there are many people looking at what I call FIB optimization 
> right now.  The key is having the programmability on the device to make it 
> happen.  Juniper/Cisco support it using policies to filter RIB->FIB and I 
> believe both also do per-NPU/PFE localized FIBs now. I am not sure if that’s 
> something supported on this new Broadcom chipset.  Depends on your network of 
> course and where you are looking to position the router.

I don't think the FIB needs to have specific support for selective
programming.

I think that comes in the code to instruct the control plane what it
should download to the FIB.

Cisco's and Juniper's support of this is on FIB that has been in
production long before the feature became available. It was just added
to code.

Mark.


Re: New Switches with Broadcom StrataDNX

2016-01-19 Thread Phil Bedard
Good point, there are many people looking at what I call FIB optimization right 
now.  The key is having the programmability on the device to make it happen.  
Juniper/Cisco support it using policies to filter RIB->FIB and I believe both 
also do per-NPU/PFE localized FIBs now. I am not sure if that’s something 
supported on this new Broadcom chipset.  Depends on your network of course and 
where you are looking to position the router.

Phil 



-Original Message-
From: Jeff Tantsura 
Date: Tuesday, January 19, 2016 at 11:46
To: Colton Conor , Phil B 
Cc: NANOG 
Subject: Re: New Switches with Broadcom StrataDNX

>Hi,
>
>Some points:
>1.DNX SDK is significantly different from SGX, adopted by Cumulus and such, 
>yet to be done, and this is not negligible amount of work
>2.if you are not interested in capacity but in scale, there’re other BCM 
>chips, perhaps more suitable
>3.you don’t have to have all the forwarding entries populated in silicon, as 
>an example - take a look at http://sdn-internet-router-sir.readthedocs.org, 
>code at https://github.com/dbarrosop/sir, one could also leverage approach we 
>have taken in EVPN - decoupling RIB from FIB completely
>4.NG silicon will do 1M+ LPM's
>
>Cheers,
>Jeff
>
>
>
>
>
>
>
>On 1/19/16, 06:29, "NANOG on behalf of Colton Conor" on behalf of colton.co...@gmail.com> wrote:
>
>>I was hoping this new Broadcom chip would be able to support enough routes
>>to hold a full BGP table, and be used for something like cumulus linux. I
>>have no need for 100G, but 10G and 40G on a platform with deeper buffers
>>sounds nice.
>>
>>On Tue, Jan 19, 2016 at 1:01 AM, Phil Bedard  wrote:
>>
>>> The BCM88670 (Jericho) is what powers the new Cisco NCS55XX devices. The
>>> processor is linerate above around 100 bytes per packet without external
>>> TCAM, supports 256K IPv4/64K IPv6 FIB entries (or mixed amounts).  These
>>> chips are being used for high scale 100G, the initial NCS5508 linecard is a
>>> 36x100G QSFP28 one.
>>>
>>> Juniper has chosen to use their own silicon for most of their dense 100G
>>> platforms, but you’ll see these chips used by pretty much everyone else I
>>> imagine at some point in the next year.
>>>
>>>
>>>
>>> Phil
>>>
>>> -Original Message-
>>> From: NANOG  on behalf of Colton Conor <
>>> colton.co...@gmail.com>
>>> Date: Sunday, January 17, 2016 at 18:15
>>> To: NANOG 
>>> Subject: New Switches with Broadcom StrataDNX
>>>
>>> >Does anyone know when the switching and router vendors will release their
>>> >new models with the Broadcom BCM88370 and BCM88670 chips? It looks like
>>> >these chips could be used as a carrier grade router and/or metro E device.
>>> >
>>> >More information here:
>>> http://www.broadcom.com/press/release.php?id=s902223
>>> >
>>> >and here:
>>> >
>>> http://www.nextplatform.com/2015/03/19/new-dune-chips-enable-heftier-switches/
>>>



Re: New Switches with Broadcom StrataDNX

2016-01-19 Thread Jeff Tantsura
Hi,

Some points:
1.DNX SDK is significantly different from SGX, adopted by Cumulus and such, yet 
to be done, and this is not negligible amount of work
2.if you are not interested in capacity but in scale, there’re other BCM chips, 
perhaps more suitable
3.you don’t have to have all the forwarding entries populated in silicon, as an 
example - take a look at http://sdn-internet-router-sir.readthedocs.org, code 
at https://github.com/dbarrosop/sir, one could also leverage approach we have 
taken in EVPN - decoupling RIB from FIB completely
4.NG silicon will do 1M+ LPM's

Cheers,
Jeff







On 1/19/16, 06:29, "NANOG on behalf of Colton Conor"  wrote:

>I was hoping this new Broadcom chip would be able to support enough routes
>to hold a full BGP table, and be used for something like cumulus linux. I
>have no need for 100G, but 10G and 40G on a platform with deeper buffers
>sounds nice.
>
>On Tue, Jan 19, 2016 at 1:01 AM, Phil Bedard  wrote:
>
>> The BCM88670 (Jericho) is what powers the new Cisco NCS55XX devices. The
>> processor is linerate above around 100 bytes per packet without external
>> TCAM, supports 256K IPv4/64K IPv6 FIB entries (or mixed amounts).  These
>> chips are being used for high scale 100G, the initial NCS5508 linecard is a
>> 36x100G QSFP28 one.
>>
>> Juniper has chosen to use their own silicon for most of their dense 100G
>> platforms, but you’ll see these chips used by pretty much everyone else I
>> imagine at some point in the next year.
>>
>>
>>
>> Phil
>>
>> -Original Message-
>> From: NANOG  on behalf of Colton Conor <
>> colton.co...@gmail.com>
>> Date: Sunday, January 17, 2016 at 18:15
>> To: NANOG 
>> Subject: New Switches with Broadcom StrataDNX
>>
>> >Does anyone know when the switching and router vendors will release their
>> >new models with the Broadcom BCM88370 and BCM88670 chips? It looks like
>> >these chips could be used as a carrier grade router and/or metro E device.
>> >
>> >More information here:
>> http://www.broadcom.com/press/release.php?id=s902223
>> >
>> >and here:
>> >
>> http://www.nextplatform.com/2015/03/19/new-dune-chips-enable-heftier-switches/
>>


Re: New Switches with Broadcom StrataDNX

2016-01-19 Thread Phil Bedard
It does support a path to use an external TCAM if vendors do that, and will 
support 1M+ entries.  It will be more expensive and the datapath will be slower 
which will impact the performance a bit.  

I think you’ll see this make its way into something like a 48x10G/4x100G (or 
40G) type platform but we’ll see.  

Phil 

From:  Colton Conor 
Date:  Tuesday, January 19, 2016 at 09:29
To:  Phil B 
Cc:  NANOG 
Subject:  Re: New Switches with Broadcom StrataDNX

I was hoping this new Broadcom chip would be able to support enough routes to 
hold a full BGP table, and be used for something like cumulus linux. I have no 
need for 100G, but 10G and 40G on a platform with deeper buffers sounds nice.

On Tue, Jan 19, 2016 at 1:01 AM, Phil Bedard  wrote:
The BCM88670 (Jericho) is what powers the new Cisco NCS55XX devices. The 
processor is linerate above around 100 bytes per packet without external TCAM, 
supports 256K IPv4/64K IPv6 FIB entries (or mixed amounts).  These chips are 
being used for high scale 100G, the initial NCS5508 linecard is a 36x100G 
QSFP28 one.

Juniper has chosen to use their own silicon for most of their dense 100G 
platforms, but you’ll see these chips used by pretty much everyone else I 
imagine at some point in the next year.



Phil

-Original Message-
From: NANOG  on behalf of Colton Conor 

Date: Sunday, January 17, 2016 at 18:15
To: NANOG 
Subject: New Switches with Broadcom StrataDNX

>Does anyone know when the switching and router vendors will release their
>new models with the Broadcom BCM88370 and BCM88670 chips? It looks like
>these chips could be used as a carrier grade router and/or metro E device.
>
>More information here: http://www.broadcom.com/press/release.php?id=s902223
>
>and here:
>http://www.nextplatform.com/2015/03/19/new-dune-chips-enable-heftier-switches/





Re: New Switches with Broadcom StrataDNX

2016-01-19 Thread Colton Conor
I was hoping this new Broadcom chip would be able to support enough routes
to hold a full BGP table, and be used for something like cumulus linux. I
have no need for 100G, but 10G and 40G on a platform with deeper buffers
sounds nice.

On Tue, Jan 19, 2016 at 1:01 AM, Phil Bedard  wrote:

> The BCM88670 (Jericho) is what powers the new Cisco NCS55XX devices. The
> processor is linerate above around 100 bytes per packet without external
> TCAM, supports 256K IPv4/64K IPv6 FIB entries (or mixed amounts).  These
> chips are being used for high scale 100G, the initial NCS5508 linecard is a
> 36x100G QSFP28 one.
>
> Juniper has chosen to use their own silicon for most of their dense 100G
> platforms, but you’ll see these chips used by pretty much everyone else I
> imagine at some point in the next year.
>
>
>
> Phil
>
> -Original Message-
> From: NANOG  on behalf of Colton Conor <
> colton.co...@gmail.com>
> Date: Sunday, January 17, 2016 at 18:15
> To: NANOG 
> Subject: New Switches with Broadcom StrataDNX
>
> >Does anyone know when the switching and router vendors will release their
> >new models with the Broadcom BCM88370 and BCM88670 chips? It looks like
> >these chips could be used as a carrier grade router and/or metro E device.
> >
> >More information here:
> http://www.broadcom.com/press/release.php?id=s902223
> >
> >and here:
> >
> http://www.nextplatform.com/2015/03/19/new-dune-chips-enable-heftier-switches/
>
>


Re: New Switches with Broadcom StrataDNX

2016-01-19 Thread Mark Tinka


On 19/Jan/16 13:54, Tarko Tikan wrote:
 
>
> Juniper silicon has one big advantage over BCM88670 - it supports 2M
> FIB entries. This makes PTX1000 (and QFX10002) very attractive
> platform for SPs.

Vendor-owned silicon will always provide better all-round performance.
It's just pricier.

Mark.


Re: New Switches with Broadcom StrataDNX

2016-01-19 Thread Tarko Tikan

hey,


Juniper has chosen to use their own silicon for most of their dense 100G 
platforms, but you’ll see these chips used by pretty much everyone else I 
imagine at some point in the next year.


Juniper silicon has one big advantage over BCM88670 - it supports 2M FIB 
entries. This makes PTX1000 (and QFX10002) very attractive platform for SPs.


--
tarko


Re: New Switches with Broadcom StrataDNX

2016-01-18 Thread Phil Bedard
The BCM88670 (Jericho) is what powers the new Cisco NCS55XX devices. The 
processor is linerate above around 100 bytes per packet without external TCAM, 
supports 256K IPv4/64K IPv6 FIB entries (or mixed amounts).  These chips are 
being used for high scale 100G, the initial NCS5508 linecard is a 36x100G 
QSFP28 one. 

Juniper has chosen to use their own silicon for most of their dense 100G 
platforms, but you’ll see these chips used by pretty much everyone else I 
imagine at some point in the next year. 



Phil 

-Original Message-
From: NANOG  on behalf of Colton Conor 

Date: Sunday, January 17, 2016 at 18:15
To: NANOG 
Subject: New Switches with Broadcom StrataDNX

>Does anyone know when the switching and router vendors will release their
>new models with the Broadcom BCM88370 and BCM88670 chips? It looks like
>these chips could be used as a carrier grade router and/or metro E device.
>
>More information here: http://www.broadcom.com/press/release.php?id=s902223
>
>and here:
>http://www.nextplatform.com/2015/03/19/new-dune-chips-enable-heftier-switches/



Re: New Switches with Broadcom StrataDNX

2016-01-18 Thread Mark Tinka


On 18/Jan/16 01:15, Colton Conor wrote:

> Does anyone know when the switching and router vendors will release their
> new models with the Broadcom BCM88370 and BCM88670 chips? It looks like
> these chips could be used as a carrier grade router and/or metro E device.
>
> More information here: http://www.broadcom.com/press/release.php?id=s902223
>
> and here:
> http://www.nextplatform.com/2015/03/19/new-dune-chips-enable-heftier-switches/

I should dig around for more information around these.

Merchant chips have focused on bandwidth scaling at the expense of key
features available in custom silicon. This has forced me to avoid
certain hardware from even the big vendors.

Bandwidth is not everything... if the approach with this new chip is
different, I'd be interested. Time to hunt...

Mark.


New Switches with Broadcom StrataDNX

2016-01-17 Thread Colton Conor
Does anyone know when the switching and router vendors will release their
new models with the Broadcom BCM88370 and BCM88670 chips? It looks like
these chips could be used as a carrier grade router and/or metro E device.

More information here: http://www.broadcom.com/press/release.php?id=s902223

and here:
http://www.nextplatform.com/2015/03/19/new-dune-chips-enable-heftier-switches/