Re: 10G switch drops traffic for a split second

2016-12-01 Thread Marian Ďurkovič
On Wed, Nov 30, 2016 at 11:58:06AM -0500, Lee wrote: > On 11/30/16, Mikael Abrahamsson wrote: > > If your switch is the typical small-buffered-switch that has become more > > and more common the past few years, then the entire switch might have > > buffer to keep packets for

Re: 10G switch drops traffic for a split second

2016-11-30 Thread Lee
On 11/30/16, Mikael Abrahamsson wrote: > On Tue, 29 Nov 2016, TJ Trout wrote: > >> Is it possible to over run the buffers of a 320gbps backplane switch >> with only 1.5gbps traffic? I think the switch is rated for 140m PPS and >> I'm only pushing 100k PPS > > If your switch is

Re: 10G switch drops traffic for a split second

2016-11-30 Thread Mikael Abrahamsson
On Tue, 29 Nov 2016, TJ Trout wrote: Is it possible to over run the buffers of a 320gbps backplane switch with only 1.5gbps traffic? I think the switch is rated for 140m PPS and I'm only pushing 100k PPS If your switch is the typical small-buffered-switch that has become more and more

Re: 10G switch drops traffic for a split second

2016-11-30 Thread Tomi Hakala
If you have congestion on outgoing interfaces you are most likely running out of packet buffer space on your switch. Especially campus class switches have small buffers, 4 MB or so and it can run out during high bursts and interface congestion. With some switches you could alleviate problem by

RE: 10G switch drops traffic for a split second

2016-11-29 Thread Luke Guillory
. . -Original Message- From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Peter Beckman Sent: Tuesday, November 29, 2016 5:10 PM To: TJ Trout Cc: nanog Subject: Re: 10G switch drops traffic for a split second On Tue, 29 Nov 2016, TJ Trout wrote: > I plan on disabling FC on everyth

Re: 10G switch drops traffic for a split second

2016-11-29 Thread Michael Loftis
Yeah you also have to look for not so obvious things like MAC Pause frames sent/received...QoS counters, all sorts of VERY platform specific stuff. Right royal pain, especially since some do not expose these statistics at all. On Tue, Nov 29, 2016 at 3:10 PM, Peter Beckman

Re: 10G switch drops traffic for a split second

2016-11-29 Thread Peter Beckman
On Tue, 29 Nov 2016, TJ Trout wrote: I plan on disabling FC on everything tonight, I've done that before but I want to be sure. Anything that can be done about the 2 x 1G peers trunking to the 10G router transition that can be fixed? should I be rate limiting the vlan for the peers at 1G so

Re: 10G switch drops traffic for a split second

2016-11-29 Thread TJ Trout
I plan on disabling FC on everything tonight, I've done that before but I want to be sure. Anything that can be done about the 2 x 1G peers trunking to the 10G router transition that can be fixed? should I be rate limiting the vlan for the peers at 1G so the 10G router isn't trying to send more

Re: 10G switch drops traffic for a split second

2016-11-29 Thread Michael Loftis
Yes it is absolutely possible to overrun the buffers. Any kind of backpressure (FC) from hosts, or 10G->1G transitions can easily cause it. Even if in a 10s window you're not over 1G if the 10G sender attempts to back to back too many frames in a row (Like say sendfile() API type calls) BOOM,

Re: 10G switch drops traffic for a split second

2016-11-29 Thread TJ Trout
Luke; All l2, no l3. only 4 vlans. 2 peers trunked to a router which trunks back to 2 devices (microwave backhauls). Chuck; All ports are 10g except the 2 peers are 1g and trunk back to a 10g port for the router wan No TCN's Brian; I have tried a IBM G8124 and a Ubiquiti ES-16-XG both show

Re: 10G switch drops traffic for a split second

2016-11-29 Thread Mikael Abrahamsson
On Tue, 29 Nov 2016, TJ Trout wrote: Could this be MTU? I've tried flow control, hard code duplex, stp on/off etc As others have pointed out, you probably have a switch with small buffers. If you also have flow control and you have something that triggers flow control to turn off packet

Re: 10G switch drops traffic for a split second

2016-11-29 Thread John Kristoff
On Tue, 29 Nov 2016 09:06:00 + TJ Trout wrote: > Could this be MTU? I've tried flow control, hard code duplex, stp on/off etc > I'm at a loss any ideas? This sounds like a common problem that certain data center environments run into with 10 Gb/s and higher loads. In a

Re: 10G switch drops traffic for a split second

2016-11-29 Thread Chuck Anderson
Without more detail, I'm grasping at straws here, but see this recent thread about QoS and microbursts on the juniper-nsp list: https://puck.nether.net/pipermail/juniper-nsp/2016-November/033692.html Do you have ports with different speeds connected? Another idea: Are you using Spanning Tree

RE: 10G switch drops traffic for a split second

2016-11-29 Thread Luke Guillory
, November 29, 2016 3:06 AM To: nanog@nanog.org Subject: 10G switch drops traffic for a split second I recently upgraded my core network from 1G to 10G and after the upgrade I have noticed that my 10G switch during peak traffic (1500mbps, 100,000pps) seems to be dropping traffic for a split second across

10G switch drops traffic for a split second

2016-11-29 Thread TJ Trout
I recently upgraded my core network from 1G to 10G and after the upgrade I have noticed that my 10G switch during peak traffic (1500mbps, 100,000pps) seems to be dropping traffic for a split second across all ports and all vlans. I immediately replaced the switch with a different brand/model and