Re: [j-nsp] Traffic delayed
Just FYI, there is a default QOS/COS config on any Juniper product. For example, “I believe” QFX5100 is set with 5% Network Control (Strict Queue 0) and 95% Best Effort (Queue 3?) or at least most EX products default to this. I do not believe any Juniper product ‘holds on to packets’ without something else getting in the way, that is some sort of congestion someplace. I’d suggest you open a TAC case and have them assist you. From: james list Date: Friday, October 5, 2018 at 12:30 AM To: Richard McGovern Cc: Juniper List Subject: Re: [j-nsp] Traffic delayed I perfectly knows the path, there is no qos configured and from what is seen there is no congestion (also because congestion cannot happen just only 30 minutes) and I do not have a tap on each cable, also there are port channels... Il Gio 4 Ott 2018, 20:58 Richard McGovern mailto:rmcgov...@juniper.net>> ha scritto: It does not. Do you know if delay if from QFX5100 or MX or both? Do you know what Queue this traffic is going into on each switch/router? From: james list mailto:jameslis...@gmail.com>> Date: Thursday, October 4, 2018 at 2:34 PM To: Richard McGovern mailto:rmcgov...@juniper.net>>, Juniper List mailto:juniper-nsp@puck.nether.net>> Subject: Re: [j-nsp] Traffic delayed Due to the fact that access switch are QFX5100 in virtual chassis, does anybody know if IS-IS managing virtual- chassis has something happening every 30 minutes which could cause delay? Cheers Il Mar 2 Ott 2018, 21:33 Richard McGovern mailto:rmcgov...@juniper.net>> ha scritto: There is no such product as an MX9K. Is your product some form of MX or an EX9200 of some type? In either case would need to know which exact modules within the MX or EX product you are using or are involved. When using the CAT6K was the edge QFX5100 previously as well? I assume QFX5100 is just L2? Sent from my iPhone > On Oct 2, 2018, at 12:37 PM, james list > mailto:jameslis...@gmail.com>> wrote: > > Dear experts > > I’ve a strange issue. > > Our customer replaced two L2/3 switches (C6500) where a pure L2 and L3 > (hsrp) environment was set-up with a couple of new MX9k running the same L2 > and L3 services but those two MX are running MPLS/VPLS to transport L3/L2 > frames. Access switches are QFX5k connected to MX MPLS PE. > > Now the main issue: the customer every almost 30 minutes (sometimes 28 > sometimes 33 minutes sometimes 30) detect some frames received with a delay > of 3-600 milliseconds. The customer is a trading venue.. > > It seems like something slow down the forwarding processing, now I know > Juniper separate forwarding and control, but I was thinking to OSPF LSA > refresh or something like that since the frequency is around 30 minutes.. > > Can anybody help me in sorting out which can be the main point here ? > > Thanks in advance > > Cheers, > > James > ___ juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp
Re: [j-nsp] Traffic delayed
On 4 October 2018 19:34:01 BST, james list wrote: >Due to the fact that access switch are QFX5100 in virtual chassis, does >anybody know if IS-IS managing virtual- chassis has something happening >every 30 minutes which could cause delay? > >Cheers As per my previous message, you should see such an event in the logs. Have you enabled verbose logging in the IS-IS trace options (and any other services running on the devices)? Cheers, James. ___ juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp
Re: [j-nsp] Traffic delayed
I perfectly knows the path, there is no qos configured and from what is seen there is no congestion (also because congestion cannot happen just only 30 minutes) and I do not have a tap on each cable, also there are port channels... Il Gio 4 Ott 2018, 20:58 Richard McGovern ha scritto: > It does not. > > > > Do you know if delay if from QFX5100 or MX or both? Do you know what > Queue this traffic is going into on each switch/router? > > > > *From: *james list > *Date: *Thursday, October 4, 2018 at 2:34 PM > *To: *Richard McGovern , Juniper List < > juniper-nsp@puck.nether.net> > *Subject: *Re: [j-nsp] Traffic delayed > > > > Due to the fact that access switch are QFX5100 in virtual chassis, does > anybody know if IS-IS managing virtual- chassis has something happening > every 30 minutes which could cause delay? > > > > Cheers > > > > Il Mar 2 Ott 2018, 21:33 Richard McGovern ha > scritto: > > There is no such product as an MX9K. Is your product some form of MX or an > EX9200 of some type? > > In either case would need to know which exact modules within the MX or EX > product you are using or are involved. > > When using the CAT6K was the edge QFX5100 previously as well? I assume > QFX5100 is just L2? > > > > Sent from my iPhone > > > On Oct 2, 2018, at 12:37 PM, james list wrote: > > > > Dear experts > > > > I’ve a strange issue. > > > > Our customer replaced two L2/3 switches (C6500) where a pure L2 and L3 > > (hsrp) environment was set-up with a couple of new MX9k running the same > L2 > > and L3 services but those two MX are running MPLS/VPLS to transport L3/L2 > > frames. Access switches are QFX5k connected to MX MPLS PE. > > > > Now the main issue: the customer every almost 30 minutes (sometimes 28 > > sometimes 33 minutes sometimes 30) detect some frames received with a > delay > > of 3-600 milliseconds. The customer is a trading venue.. > > > > It seems like something slow down the forwarding processing, now I know > > Juniper separate forwarding and control, but I was thinking to OSPF LSA > > refresh or something like that since the frequency is around 30 minutes.. > > > > Can anybody help me in sorting out which can be the main point here ? > > > > Thanks in advance > > > > Cheers, > > > > James > > > > ___ juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp
Re: [j-nsp] Traffic delayed
It does not. Do you know if delay if from QFX5100 or MX or both? Do you know what Queue this traffic is going into on each switch/router? From: james list Date: Thursday, October 4, 2018 at 2:34 PM To: Richard McGovern , Juniper List Subject: Re: [j-nsp] Traffic delayed Due to the fact that access switch are QFX5100 in virtual chassis, does anybody know if IS-IS managing virtual- chassis has something happening every 30 minutes which could cause delay? Cheers Il Mar 2 Ott 2018, 21:33 Richard McGovern mailto:rmcgov...@juniper.net>> ha scritto: There is no such product as an MX9K. Is your product some form of MX or an EX9200 of some type? In either case would need to know which exact modules within the MX or EX product you are using or are involved. When using the CAT6K was the edge QFX5100 previously as well? I assume QFX5100 is just L2? Sent from my iPhone > On Oct 2, 2018, at 12:37 PM, james list > mailto:jameslis...@gmail.com>> wrote: > > Dear experts > > I’ve a strange issue. > > Our customer replaced two L2/3 switches (C6500) where a pure L2 and L3 > (hsrp) environment was set-up with a couple of new MX9k running the same L2 > and L3 services but those two MX are running MPLS/VPLS to transport L3/L2 > frames. Access switches are QFX5k connected to MX MPLS PE. > > Now the main issue: the customer every almost 30 minutes (sometimes 28 > sometimes 33 minutes sometimes 30) detect some frames received with a delay > of 3-600 milliseconds. The customer is a trading venue.. > > It seems like something slow down the forwarding processing, now I know > Juniper separate forwarding and control, but I was thinking to OSPF LSA > refresh or something like that since the frequency is around 30 minutes.. > > Can anybody help me in sorting out which can be the main point here ? > > Thanks in advance > > Cheers, > > James > ___ juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp
Re: [j-nsp] Traffic delayed
Due to the fact that access switch are QFX5100 in virtual chassis, does anybody know if IS-IS managing virtual- chassis has something happening every 30 minutes which could cause delay? Cheers Il Mar 2 Ott 2018, 21:33 Richard McGovern ha scritto: > There is no such product as an MX9K. Is your product some form of MX or an > EX9200 of some type? > > In either case would need to know which exact modules within the MX or EX > product you are using or are involved. > > When using the CAT6K was the edge QFX5100 previously as well? I assume > QFX5100 is just L2? > > > > Sent from my iPhone > > > On Oct 2, 2018, at 12:37 PM, james list wrote: > > > > Dear experts > > > > I’ve a strange issue. > > > > Our customer replaced two L2/3 switches (C6500) where a pure L2 and L3 > > (hsrp) environment was set-up with a couple of new MX9k running the same > L2 > > and L3 services but those two MX are running MPLS/VPLS to transport L3/L2 > > frames. Access switches are QFX5k connected to MX MPLS PE. > > > > Now the main issue: the customer every almost 30 minutes (sometimes 28 > > sometimes 33 minutes sometimes 30) detect some frames received with a > delay > > of 3-600 milliseconds. The customer is a trading venue.. > > > > It seems like something slow down the forwarding processing, now I know > > Juniper separate forwarding and control, but I was thinking to OSPF LSA > > refresh or something like that since the frequency is around 30 minutes.. > > > > Can anybody help me in sorting out which can be the main point here ? > > > > Thanks in advance > > > > Cheers, > > > > James > > > ___ juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp
Re: [j-nsp] Traffic delayed
on access qfx5100 is disabled flow control Il giorno mer 3 ott 2018 alle ore 06:50 Eldon Koyle < ekoyle+puck.nether@gmail.com> ha scritto: > Have you checked flow control counters? > > -- > Eldon > > > On Tue, Oct 2, 2018, 16:22 james list wrote: > >> I put on both lists cause we had cisco and we have now juniper. Hence >> maybe >> this is something known by cisco guru as well. >> >> I have not a mx960 in lab unfortunately, no cpu spikes, no relevant logs. >> >> Upgrade is not in roadmap since we re in 16.1 >> >> Cheers >> >> Il Mar 2 Ott 2018, 21:19 James Bensley ha scritto: >> >> > On Tue, 2 Oct 2018 at 19:59, james list wrote: >> > > >> > > Can you elaborate? >> > > Why just every 30 minutes the issue? >> > >> > Seeing as you have an all Juniper set up I don't think there is a need >> > to cross-post to two lists simultaneously. If you feel there is a >> > need, please post to the two lists separately as not all subscribers >> > will be subscribed to both lists. >> > >> > What basic troubleshooting have you done so far? What have you ruled >> out? >> > >> > The very first think you should have done is try to replicate the >> > issue in the lab, can you replicate it? >> > >> > If yes, have you tried a code upgrade to see if this fixes anything? >> > Or changing any settings? >> > >> > If not and you've only got the issue in production, can you enable >> > some logging to see if there is anything in the logs when the issues >> > happens? Do you see any packet drops on interfaces when the issue >> > happens? CPU spikes? Anything? >> > >> > So far you haven't provided any data at all on the problem or what you >> > have tried to do to resolve it, before coming to the list. >> > >> > Cheers, >> > James. >> > >> ___ >> juniper-nsp mailing list juniper-nsp@puck.nether.net >> https://puck.nether.net/mailman/listinfo/juniper-nsp >> > ___ juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp
Re: [j-nsp] Traffic delayed
There is no such product as an MX9K. Is your product some form of MX or an EX9200 of some type? In either case would need to know which exact modules within the MX or EX product you are using or are involved. When using the CAT6K was the edge QFX5100 previously as well? I assume QFX5100 is just L2? Sent from my iPhone > On Oct 2, 2018, at 12:37 PM, james list wrote: > > Dear experts > > I’ve a strange issue. > > Our customer replaced two L2/3 switches (C6500) where a pure L2 and L3 > (hsrp) environment was set-up with a couple of new MX9k running the same L2 > and L3 services but those two MX are running MPLS/VPLS to transport L3/L2 > frames. Access switches are QFX5k connected to MX MPLS PE. > > Now the main issue: the customer every almost 30 minutes (sometimes 28 > sometimes 33 minutes sometimes 30) detect some frames received with a delay > of 3-600 milliseconds. The customer is a trading venue.. > > It seems like something slow down the forwarding processing, now I know > Juniper separate forwarding and control, but I was thinking to OSPF LSA > refresh or something like that since the frequency is around 30 minutes.. > > Can anybody help me in sorting out which can be the main point here ? > > Thanks in advance > > Cheers, > > James > ___ juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp
Re: [j-nsp] Traffic delayed
On Tue, 2 Oct 2018 at 19:59, james list wrote: > > Can you elaborate? > Why just every 30 minutes the issue? Seeing as you have an all Juniper set up I don't think there is a need to cross-post to two lists simultaneously. If you feel there is a need, please post to the two lists separately as not all subscribers will be subscribed to both lists. What basic troubleshooting have you done so far? What have you ruled out? The very first think you should have done is try to replicate the issue in the lab, can you replicate it? If yes, have you tried a code upgrade to see if this fixes anything? Or changing any settings? If not and you've only got the issue in production, can you enable some logging to see if there is anything in the logs when the issues happens? Do you see any packet drops on interfaces when the issue happens? CPU spikes? Anything? So far you haven't provided any data at all on the problem or what you have tried to do to resolve it, before coming to the list. Cheers, James. ___ juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp
Re: [j-nsp] Traffic delayed
Can you elaborate? Why just every 30 minutes the issue? Il Mar 2 Ott 2018, 20:34 Tom Beecher ha scritto: > You have switches with completely different buffer depths than you used > to. You prob want to look into that. > > On Tue, Oct 2, 2018 at 9:39 AM james list wrote: > >> Dear experts >> >> I’ve a strange issue. >> >> Our customer replaced two L2/3 switches (C6500) where a pure L2 and L3 >> (hsrp) environment was set-up with a couple of new MX9k running the same >> L2 >> and L3 services but those two MX are running MPLS/VPLS to transport L3/L2 >> frames. Access switches are QFX5k connected to MX MPLS PE. >> >> Now the main issue: the customer every almost 30 minutes (sometimes 28 >> sometimes 33 minutes sometimes 30) detect some frames received with a >> delay >> of 3-600 milliseconds. The customer is a trading venue.. >> >> It seems like something slow down the forwarding processing, now I know >> Juniper separate forwarding and control, but I was thinking to OSPF LSA >> refresh or something like that since the frequency is around 30 minutes.. >> >> Can anybody help me in sorting out which can be the main point here ? >> >> Thanks in advance >> >> Cheers, >> >> James >> ___ >> juniper-nsp mailing list juniper-nsp@puck.nether.net >> https://puck.nether.net/mailman/listinfo/juniper-nsp >> > ___ juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp
Re: [j-nsp] Traffic delayed
You have switches with completely different buffer depths than you used to. You prob want to look into that. On Tue, Oct 2, 2018 at 9:39 AM james list wrote: > Dear experts > > I’ve a strange issue. > > Our customer replaced two L2/3 switches (C6500) where a pure L2 and L3 > (hsrp) environment was set-up with a couple of new MX9k running the same L2 > and L3 services but those two MX are running MPLS/VPLS to transport L3/L2 > frames. Access switches are QFX5k connected to MX MPLS PE. > > Now the main issue: the customer every almost 30 minutes (sometimes 28 > sometimes 33 minutes sometimes 30) detect some frames received with a delay > of 3-600 milliseconds. The customer is a trading venue.. > > It seems like something slow down the forwarding processing, now I know > Juniper separate forwarding and control, but I was thinking to OSPF LSA > refresh or something like that since the frequency is around 30 minutes.. > > Can anybody help me in sorting out which can be the main point here ? > > Thanks in advance > > Cheers, > > James > ___ > juniper-nsp mailing list juniper-nsp@puck.nether.net > https://puck.nether.net/mailman/listinfo/juniper-nsp > ___ juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp
[j-nsp] Traffic delayed
Dear experts I’ve a strange issue. Our customer replaced two L2/3 switches (C6500) where a pure L2 and L3 (hsrp) environment was set-up with a couple of new MX9k running the same L2 and L3 services but those two MX are running MPLS/VPLS to transport L3/L2 frames. Access switches are QFX5k connected to MX MPLS PE. Now the main issue: the customer every almost 30 minutes (sometimes 28 sometimes 33 minutes sometimes 30) detect some frames received with a delay of 3-600 milliseconds. The customer is a trading venue.. It seems like something slow down the forwarding processing, now I know Juniper separate forwarding and control, but I was thinking to OSPF LSA refresh or something like that since the frequency is around 30 minutes.. Can anybody help me in sorting out which can be the main point here ? Thanks in advance Cheers, James ___ juniper-nsp mailing list juniper-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/juniper-nsp