Re: [uknof] 10gb switch

[Brian Candler]

On 17/09/2015 21:12, Brian Candler wrote:
I have good experience with Netgear XSM7224S (only used for layer 2), 
but that's considerably more expensive. 

I remembered there is a cheaper model:
http://netgear.co.uk/business/products/switches/smart/XS712T.aspx#tab-techspecs

This is not a proper managed switch with CLI: it is a "smart" switch 
with web management only, maybe not even SNMP. And I have never used it 
so can't vouch for it.


However it does meet the "1U" requirement, and it does fit the budget 
(£966+VAT on comms-express.com). It has 12 copper ports, two of which 
can be SFP+ instead.

Re: [uknof] 10gb switch

[Pete Stevens]

if there's budget to spend £4000 on a 10G switch, the OP should look at
something like a QuantaMesh BMS T3048-LY8, which will run one of the ONIE
operating systems (i.e. linux).  This will give 48x10G + 4x40G instead of
24x10G.


+1

We've deployed a few of these to production, c.f.

http://blog.mythic-beasts.com/2015/09/14/linux-for-switches/

Regards,

Pete

--
Pete Stevens
p...@ex-parrot.com
http://www.ex-parrot.com/~pete/

The last time humans crossed space to a destination was the Apollo 17 mission
in 1972. In the 32 years since, no man has seen, with his own eyes, Earth as
that beautiful, solitary blue sphere, and - reality check - no woman has ever
seen it at all.
   -- James Cameron

Re: [uknof] 10gb switch

[Richard Halfpenny]

On 18/09/2015 12:19, Pete Stevens wrote:
>> if there's budget to spend £4000 on a 10G switch, the OP should look at
>> something like a QuantaMesh BMS T3048-LY8, which will run one of the ONIE
>> operating systems (i.e. linux).  This will give 48x10G + 4x40G instead of
>> 24x10G.
> 
> +1

+1 here too.  Although the T3048-LY8 is 6x40G and not 4 - two QSFP+ are
hiding on the back panel ;)

Rich.


Network Operations
Exa Networks Ltd :: AS30740
richard.halfpe...@exa-networks.co.uk

Re: [uknof] 10gb switch

[Tom Smyth]

HI lads,
what is the stability like in cumulus  what is the uI /cli like ? does it
have a nice cli ? or does it depend on openflow controlers and stuff like
that ?
 that was the one thing I was worried about when looking at 10 g
switches...

Thanks

On Fri, Sep 18, 2015 at 1:03 PM, Pete Stevens  wrote:

> So from the blog post it seems it has "all the advantages of a linux OS"
>> except that you can't even install the version of vim or git that you
>> actually want? This sounds quite a bit like vendor lock-in, just with a
>> smaller vendor...
>>
>> Genuinely hoping I misunderstood though!
>>
>
> It's an out of the box complaint - building additional packages isn't
> very hard but it'd be nice if their repository contained
> $all_the_things. It was annoying while playing and experimenting - now
> it's just ./build-network.sh and the magic happens.
>
>
> Pete
>
> --
> Pete Stevens
> p...@ex-parrot.com
> http://www.ex-parrot.com/~pete/
>
> The last time humans crossed space to a destination was the Apollo 17
> mission
> in 1972. In the 32 years since, no man has seen, with his own eyes, Earth
> as
> that beautiful, solitary blue sphere, and - reality check - no woman has
> ever
> seen it at all.
>-- James Cameron
>
>


-- 
Kindest regards,
Tom Smyth

Mobile: +353 87 6193172
-
PLEASE CONSIDER THE ENVIRONMENT BEFORE YOU PRINT THIS E-MAIL
This email contains information which may be confidential or privileged.
The information is intended solely for the use of the individual or entity
named above.  If you are not the intended recipient, be aware that
any disclosure, copying, distribution or use of the contents of this
information is prohibited. If you have received this electronic
transmission in error, please notify me by telephone or by electronic mail
immediately. Any opinions expressed are those of the author, not the
company's  .This email does not constitute either offer or acceptance of
any contractually binding agreement. Such offer or acceptance must be
communicated in
writing. You are requested to carry out your own virus check before opening
any attachment. Thomas Smyth accepts no liability for any loss or damage
which may be caused by malicious software or attachments.

Re: [uknof] 10gb switch

[Nick Hilliard]

On 18/09/2015 13:29, Maria Blackmore wrote:
> What does throughput and latency look like in the real world?

if they're trident/T+/T2 chipsets, then they will do line rate on all ports
with small packets.  Latency is dependent on forwarding mode, i.e. slightly
lower for cut-thru than for store-n-forward.  afair, the cut-thru marketing
latency on T2 is 500ns.

Bear in mind that linux is only the control plane operating system and has
nothing to do with the underlying forwarding mechanism.

Nick

Re: [uknof] 10gb switch

[Pete Stevens]

So from the blog post it seems it has "all the advantages of a linux OS" 
except that you can't even install the version of vim or git that you 
actually want? This sounds quite a bit like vendor lock-in, just with a 
smaller vendor...


Genuinely hoping I misunderstood though!


It's an out of the box complaint - building additional packages isn't
very hard but it'd be nice if their repository contained
$all_the_things. It was annoying while playing and experimenting - now
it's just ./build-network.sh and the magic happens.

Pete

--
Pete Stevens
p...@ex-parrot.com
http://www.ex-parrot.com/~pete/

The last time humans crossed space to a destination was the Apollo 17 mission
in 1972. In the 32 years since, no man has seen, with his own eyes, Earth as
that beautiful, solitary blue sphere, and - reality check - no woman has ever
seen it at all.
   -- James Cameron

Re: [uknof] 10gb switch

[Pete Stevens]

what is the stability like in cumulus  what is the uI /cli like ? does it
have a nice cli ? or does it depend on openflow controlers and stuff like
that ?
 that was the one thing I was worried about when looking at 10 g
switches... 


It's bash. It's just like using a linux machine,

e.g.

# ethtool swp1
Settings for swp1:
Supported ports: [ TP ]
Supported link modes:   10baseT/Full
100baseT/Full
1000baseT/Full
1baseT/Full
Supported pause frame use: Symmetric Receive-only
Supports auto-negotiation: Yes
Advertised link modes:  1000baseT/Full
1baseT/Full
Advertised pause frame use: Symmetric
Advertised auto-negotiation: No
Speed: 1Mb/s
Duplex: Full
Port: FIBRE
PHYAD: 0
Transceiver: external
Auto-negotiation: off
Current message level: 0x (0)

Link detected: yes


# ip route
default via a.b.c.d dev eth0
e.f.g.h/21 dev eth0  proto kernel  scope link  src h.i.j.k


You write a big /etc/network/interfaces file, then run ifup -a. If
you're a Linux server person it makes a lot of sense, if you're not it's
probably utterly baffling!

Pete

--
Pete Stevens
p...@ex-parrot.com
http://www.ex-parrot.com/~pete/

The last time humans crossed space to a destination was the Apollo 17 mission
in 1972. In the 32 years since, no man has seen, with his own eyes, Earth as
that beautiful, solitary blue sphere, and - reality check - no woman has ever
seen it at all.
   -- James Cameron

Re: [uknof] 10gb switch

[Maria Blackmore]

On 18 September 2015 at 13:11, Tom Smyth 
wrote:

> what is the stability like in cumulus  what is the uI /cli like ? does it
> have a nice cli ? or does it depend on openflow controlers and stuff like
> that ?
>  that was the one thing I was worried about when looking at 10 g
> switches...
>

What does throughput and latency look like in the real world?

-- 
Maria Blackmore
Professional Network Fairy

Re: [uknof] 10gb switch

[Tim Bray]

On 17/09/15 21:12, Brian Candler wrote:
> I have good experience with Netgear XSM7224S (only used for layer 2),
> but that's considerably more expensive.

We stock some netgear here.  That is the product I came across, but we
don't stock it.  Looks to be just the job, but about £4000+ though.

If it is for more than one, I could get somebody to price them up.

You should have grabbed the guy at google yesterday.



Tim

Re: [uknof] 10gb switch

[Tom Bird]

On 18/09/15 13:03, Pete Stevens wrote:

So from the blog post it seems it has "all the advantages of a linux
OS" except that you can't even install the version of vim or git that
you actually want? This sounds quite a bit like vendor lock-in, just
with a smaller vendor...

Genuinely hoping I misunderstood though!


It's an out of the box complaint - building additional packages isn't
very hard but it'd be nice if their repository contained
$all_the_things. It was annoying while playing and experimenting - now
it's just ./build-network.sh and the magic happens.


No need to build anything, just add Debian's apt repositories to the 
switch config, even works for the non-x86 control planes.


We run Cumulus on our kit at IXLeeds:

root@10gb-1:~# git --version
git version 1.7.10.4

installed from ftp.uk.debian.org.

--
Tom

:: www.portfast.co.uk / @portfast
:: hosted services, domains, virtual machines, consultancy