Re: [Ubnt_users] AF5x packet loss
What routing protocols are you using across those links? -- On 2/22/2018 1:54 AM, Kristian Hoffmann wrote: > Hi, > > This is going to sound crazy, but here we go... > > Has anyone seen packet loss across an AF5x link that occurred exactly > every 30 seconds? I have a couple of links, on completely different > towers, that drop packets every 30 seconds. I can observe it using the > MikroTik traffic generator, or a fast ping (size=1500 interval=.05). > Even though they do it on a 30 second interval, it's not at the same > time (intervals are not synchronized). They're not bridged together in > any way, and even do it with no customer traffic on them whatsoever. > > I've tried with and without flow control, every wireless setting, > with/without management vlan, firmware 4.0 and 4.0.3, etc. As they're > connected to RB3011's, I even disabled the MikroTik LCD, as apparently > that's a thing. It's a shot in the dark, but... anyone? > > Thanks, > > -Kristian > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org > http://lists.wispa.org/mailman/listinfo/ubnt_users -- West Michigan Wireless ISP Allegan, Michigan 49010 269-686-8648 A Division of: Camp Communication Services, INC ___ Ubnt_users mailing list Ubnt_users@wispa.org http://lists.wispa.org/mailman/listinfo/ubnt_users
Re: [Ubnt_users] AF5x packet loss
Definitely through the wireless link? Not including the Ethernet? Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373 On Feb 22, 2018 3:19 AM, "Blair Davis" wrote: > What routing protocols are you using across those links? > > -- > > > On 2/22/2018 1:54 AM, Kristian Hoffmann wrote: > > Hi, > > > > This is going to sound crazy, but here we go... > > > > Has anyone seen packet loss across an AF5x link that occurred exactly > > every 30 seconds? I have a couple of links, on completely different > > towers, that drop packets every 30 seconds. I can observe it using the > > MikroTik traffic generator, or a fast ping (size=1500 interval=.05). > > Even though they do it on a 30 second interval, it's not at the same > > time (intervals are not synchronized). They're not bridged together in > > any way, and even do it with no customer traffic on them whatsoever. > > > > I've tried with and without flow control, every wireless setting, > > with/without management vlan, firmware 4.0 and 4.0.3, etc. As they're > > connected to RB3011's, I even disabled the MikroTik LCD, as apparently > > that's a thing. It's a shot in the dark, but... anyone? > > > > Thanks, > > > > -Kristian > > ___ > > Ubnt_users mailing list > > Ubnt_users@wispa.org > > http://lists.wispa.org/mailman/listinfo/ubnt_users > > -- > West Michigan Wireless ISP > Allegan, Michigan 49010 > 269-686-8648 > > A Division of: > Camp Communication Services, INC > > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org > http://lists.wispa.org/mailman/listinfo/ubnt_users > ___ Ubnt_users mailing list Ubnt_users@wispa.org http://lists.wispa.org/mailman/listinfo/ubnt_users
Re: [Ubnt_users] AF5x packet loss
We had a similar issue with an AF24 link. In adition to the packet loss, one end has a netonix on it that showed errors. After replacing everything on the side with the netonix, we found replacing the POE (did not have netonix on that side) on the far side fixed the problem - Scott M Piehn From: Josh Luthman Sent: Thursday, February 22, 2018 7:18 AM To: Ubiquiti Users Group Subject: Re: [Ubnt_users] AF5x packet loss Definitely through the wireless link? Not including the Ethernet? Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373 On Feb 22, 2018 3:19 AM, "Blair Davis" wrote: What routing protocols are you using across those links? -- On 2/22/2018 1:54 AM, Kristian Hoffmann wrote: > Hi, > > This is going to sound crazy, but here we go... > > Has anyone seen packet loss across an AF5x link that occurred exactly > every 30 seconds? I have a couple of links, on completely different > towers, that drop packets every 30 seconds. I can observe it using the > MikroTik traffic generator, or a fast ping (size=1500 interval=.05). > Even though they do it on a 30 second interval, it's not at the same > time (intervals are not synchronized). They're not bridged together in > any way, and even do it with no customer traffic on them whatsoever. > > I've tried with and without flow control, every wireless setting, > with/without management vlan, firmware 4.0 and 4.0.3, etc. As they're > connected to RB3011's, I even disabled the MikroTik LCD, as apparently > that's a thing. It's a shot in the dark, but... anyone? > > Thanks, > > -Kristian > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org > http://lists.wispa.org/mailman/listinfo/ubnt_users -- West Michigan Wireless ISP Allegan, Michigan 49010 269-686-8648 A Division of: Camp Communication Services, INC ___ Ubnt_users mailing list Ubnt_users@wispa.org http://lists.wispa.org/mailman/listinfo/ubnt_users ___ Ubnt_users mailing list Ubnt_users@wispa.org http://lists.wispa.org/mailman/listinfo/ubnt_users ___ Ubnt_users mailing list Ubnt_users@wispa.org http://lists.wispa.org/mailman/listinfo/ubnt_users
Re: [Ubnt_users] AF5x packet loss
I wish these had a loopback test, because that would be an easy way to find out. The wireless capacity during the events is a nice straight line, so there's no indication that it's a wireless problem, but that doesn't rule it out either. I'll run some tests pinging the radio itself at the same time, and see if there's loss to the radio as well. Generally, OSPF is running over these links, but I've disabled the OSPF instance and have the same results. -Kristian On Thu, 2018-02-22 at 08:18 -0500, Josh Luthman wrote: > Definitely through the wireless link? Not including the Ethernet? > > Josh Luthman > Office: 937-552-2340 > Direct: 937-552-2343 > 1100 Wayne St > Suite 1337 > Troy, OH 45373 > > On Feb 22, 2018 3:19 AM, "Blair Davis" wrote: > > What routing protocols are you using across those links? > > > > -- > > > > > > On 2/22/2018 1:54 AM, Kristian Hoffmann wrote: > > > Hi, > > > > > > This is going to sound crazy, but here we go... > > > > > > Has anyone seen packet loss across an AF5x link that occurred > > exactly > > > every 30 seconds? I have a couple of links, on completely > > different > > > towers, that drop packets every 30 seconds. I can observe it > > using the > > > MikroTik traffic generator, or a fast ping (size=1500 > > interval=.05). > > > Even though they do it on a 30 second interval, it's not at the > > same > > > time (intervals are not synchronized). They're not bridged > > together in > > > any way, and even do it with no customer traffic on them > > whatsoever. > > > > > > I've tried with and without flow control, every wireless setting, > > > with/without management vlan, firmware 4.0 and 4.0.3, etc. As > > they're > > > connected to RB3011's, I even disabled the MikroTik LCD, as > > apparently > > > that's a thing. It's a shot in the dark, but... anyone? > > > > > > Thanks, > > > > > > -Kristian > > > ___ > > > Ubnt_users mailing list > > > Ubnt_users@wispa.org > > > http://lists.wispa.org/mailman/listinfo/ubnt_users > > > > -- > > West Michigan Wireless ISP > > Allegan, Michigan 49010 > > 269-686-8648 > > > > A Division of: > > Camp Communication Services, INC > > > > ___ > > Ubnt_users mailing list > > Ubnt_users@wispa.org > > http://lists.wispa.org/mailman/listinfo/ubnt_users > > > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org > http://lists.wispa.org/mailman/listinfo/ubnt_users___ Ubnt_users mailing list Ubnt_users@wispa.org http://lists.wispa.org/mailman/listinfo/ubnt_users
Re: [Ubnt_users] AF5x packet loss
What firmware do you have on the RB3011s? The factory firmware (6.34?) had packet loss issues that was fixed around 6.36.4. From: ubnt_users-boun...@wispa.org [mailto:ubnt_users-boun...@wispa.org] On Behalf Of Kristian Hoffmann Sent: Thursday, February 22, 2018 2:34 PM To: Ubiquiti Users Group Subject: Re: [Ubnt_users] AF5x packet loss I wish these had a loopback test, because that would be an easy way to find out. The wireless capacity during the events is a nice straight line, so there's no indication that it's a wireless problem, but that doesn't rule it out either. I'll run some tests pinging the radio itself at the same time, and see if there's loss to the radio as well. Generally, OSPF is running over these links, but I've disabled the OSPF instance and have the same results. -Kristian On Thu, 2018-02-22 at 08:18 -0500, Josh Luthman wrote: Definitely through the wireless link? Not including the Ethernet? Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373 On Feb 22, 2018 3:19 AM, "Blair Davis" mailto:the...@wmwisp.net> > wrote: What routing protocols are you using across those links? -- On 2/22/2018 1:54 AM, Kristian Hoffmann wrote: > Hi, > > This is going to sound crazy, but here we go... > > Has anyone seen packet loss across an AF5x link that occurred exactly > every 30 seconds? I have a couple of links, on completely different > towers, that drop packets every 30 seconds. I can observe it using the > MikroTik traffic generator, or a fast ping (size=1500 interval=.05). > Even though they do it on a 30 second interval, it's not at the same > time (intervals are not synchronized). They're not bridged together in > any way, and even do it with no customer traffic on them whatsoever. > > I've tried with and without flow control, every wireless setting, > with/without management vlan, firmware 4.0 and 4.0.3, etc. As they're > connected to RB3011's, I even disabled the MikroTik LCD, as apparently > that's a thing. It's a shot in the dark, but... anyone? > > Thanks, > > -Kristian > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org <mailto:Ubnt_users@wispa.org> > http://lists.wispa.org/mailman/listinfo/ubnt_users -- West Michigan Wireless ISP Allegan, Michigan 49010 269-686-8648 A Division of: Camp Communication Services, INC ___ Ubnt_users mailing list Ubnt_users@wispa.org <mailto:Ubnt_users@wispa.org> http://lists.wispa.org/mailman/listinfo/ubnt_users ___ Ubnt_users mailing list Ubnt_users@wispa.org <mailto:Ubnt_users@wispa.org> http://lists.wispa.org/mailman/listinfo/ubnt_users ___ Ubnt_users mailing list Ubnt_users@wispa.org http://lists.wispa.org/mailman/listinfo/ubnt_users
Re: [Ubnt_users] AF5x packet loss
Why do you need a loopback test when the capacity graph says the same thing in real time? I would definitely start by doing a ping between radios and see if it's the wireless link versus ethernet/ports/etc. Last time I saw this, it was caused by a surge suppressor making the link go down/up super fast (I would get about 1 packet lost per 5 minutes). Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373 On Thu, Feb 22, 2018 at 3:34 PM, Kristian Hoffmann wrote: > I wish these had a loopback test, because that would be an easy way to > find out. The wireless capacity during the events is a nice straight line, > so there's no indication that it's a wireless problem, but that doesn't > rule it out either. > > I'll run some tests pinging the radio itself at the same time, and see if > there's loss to the radio as well. > > Generally, OSPF is running over these links, but I've disabled the OSPF > instance and have the same results. > > -Kristian > > On Thu, 2018-02-22 at 08:18 -0500, Josh Luthman wrote: > > Definitely through the wireless link? Not including the Ethernet? > > Josh Luthman > Office: 937-552-2340 <(937)%20552-2340> > Direct: 937-552-2343 <(937)%20552-2343> > 1100 Wayne St > Suite 1337 > Troy, OH 45373 > > On Feb 22, 2018 3:19 AM, "Blair Davis" wrote: > > What routing protocols are you using across those links? > > -- > > > On 2/22/2018 1:54 AM, Kristian Hoffmann wrote: > > Hi, > > > > This is going to sound crazy, but here we go... > > > > Has anyone seen packet loss across an AF5x link that occurred exactly > > every 30 seconds? I have a couple of links, on completely different > > towers, that drop packets every 30 seconds. I can observe it using the > > MikroTik traffic generator, or a fast ping (size=1500 interval=.05). > > Even though they do it on a 30 second interval, it's not at the same > > time (intervals are not synchronized). They're not bridged together in > > any way, and even do it with no customer traffic on them whatsoever. > > > > I've tried with and without flow control, every wireless setting, > > with/without management vlan, firmware 4.0 and 4.0.3, etc. As they're > > connected to RB3011's, I even disabled the MikroTik LCD, as apparently > > that's a thing. It's a shot in the dark, but... anyone? > > > > Thanks, > > > > -Kristian > > ___ > > Ubnt_users mailing list > > Ubnt_users@wispa.org > > http://lists.wispa.org/mailman/listinfo/ubnt_users > > -- > West Michigan Wireless ISP > Allegan, Michigan 49010 > 269-686-8648 > > A Division of: > Camp Communication Services, INC > > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org > http://lists.wispa.org/mailman/listinfo/ubnt_users > > ___ > Ubnt_users mailing > listUbnt_users@wispa.orghttp://lists.wispa.org/mailman/listinfo/ubnt_users > > > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org > http://lists.wispa.org/mailman/listinfo/ubnt_users > > ___ Ubnt_users mailing list Ubnt_users@wispa.org http://lists.wispa.org/mailman/listinfo/ubnt_users
Re: [Ubnt_users] AF5x packet loss
+1 on the darned surge protectors! On Thu, Feb 22, 2018 at 3:37 PM, Josh Luthman wrote: > Why do you need a loopback test when the capacity graph says the same > thing in real time? > > I would definitely start by doing a ping between radios and see if it's > the wireless link versus ethernet/ports/etc. Last time I saw this, it was > caused by a surge suppressor making the link go down/up super fast (I would > get about 1 packet lost per 5 minutes). > > > Josh Luthman > Office: 937-552-2340 > Direct: 937-552-2343 > 1100 Wayne St > Suite 1337 > Troy, OH 45373 > > On Thu, Feb 22, 2018 at 3:34 PM, Kristian Hoffmann > wrote: > >> I wish these had a loopback test, because that would be an easy way to >> find out. The wireless capacity during the events is a nice straight line, >> so there's no indication that it's a wireless problem, but that doesn't >> rule it out either. >> >> I'll run some tests pinging the radio itself at the same time, and see if >> there's loss to the radio as well. >> >> Generally, OSPF is running over these links, but I've disabled the OSPF >> instance and have the same results. >> >> -Kristian >> >> On Thu, 2018-02-22 at 08:18 -0500, Josh Luthman wrote: >> >> Definitely through the wireless link? Not including the Ethernet? >> >> Josh Luthman >> Office: 937-552-2340 <(937)%20552-2340> >> Direct: 937-552-2343 <(937)%20552-2343> >> 1100 Wayne St >> Suite 1337 >> Troy, OH 45373 >> >> On Feb 22, 2018 3:19 AM, "Blair Davis" wrote: >> >> What routing protocols are you using across those links? >> >> -- >> >> >> On 2/22/2018 1:54 AM, Kristian Hoffmann wrote: >> > Hi, >> > >> > This is going to sound crazy, but here we go... >> > >> > Has anyone seen packet loss across an AF5x link that occurred exactly >> > every 30 seconds? I have a couple of links, on completely different >> > towers, that drop packets every 30 seconds. I can observe it using the >> > MikroTik traffic generator, or a fast ping (size=1500 interval=.05). >> > Even though they do it on a 30 second interval, it's not at the same >> > time (intervals are not synchronized). They're not bridged together in >> > any way, and even do it with no customer traffic on them whatsoever. >> > >> > I've tried with and without flow control, every wireless setting, >> > with/without management vlan, firmware 4.0 and 4.0.3, etc. As they're >> > connected to RB3011's, I even disabled the MikroTik LCD, as apparently >> > that's a thing. It's a shot in the dark, but... anyone? >> > >> > Thanks, >> > >> > -Kristian >> > ___ >> > Ubnt_users mailing list >> > Ubnt_users@wispa.org >> > http://lists.wispa.org/mailman/listinfo/ubnt_users >> >> -- >> West Michigan Wireless ISP >> Allegan, Michigan 49010 >> 269-686-8648 >> >> A Division of: >> Camp Communication Services, INC >> >> ___ >> Ubnt_users mailing list >> Ubnt_users@wispa.org >> http://lists.wispa.org/mailman/listinfo/ubnt_users >> >> ___ >> Ubnt_users mailing >> listUbnt_users@wispa.orghttp://lists.wispa.org/mailman/listinfo/ubnt_users >> >> >> ___ >> Ubnt_users mailing list >> Ubnt_users@wispa.org >> http://lists.wispa.org/mailman/listinfo/ubnt_users >> >> > > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org > http://lists.wispa.org/mailman/listinfo/ubnt_users > > -- -RickG ___ Ubnt_users mailing list Ubnt_users@wispa.org http://lists.wispa.org/mailman/listinfo/ubnt_users
Re: [Ubnt_users] AF5x packet loss
For the archives... The issue turned out to be an old PtP radio that was decommissioned, but not removed from the tower. The ethernet interface of the radio would start flapping during certain times of the day. That interface was connected to a router on an interface still configured for OSPF. Every time the interface flapped, it would trigged a topology change. The frequency of the topology changes appeared to be causing sub- second bursts of packet loss that occurred every 30 seconds. We found it by turning on OSPF debug logging and tallying the number of topology changes by originator ID. The one at the top of the list was our culprit. hth, -Kristian On Fri, 2018-02-23 at 03:23 -0500, RickG wrote: > +1 on the darned surge protectors! > > On Thu, Feb 22, 2018 at 3:37 PM, Josh Luthman > c.com> wrote: > > Why do you need a loopback test when the capacity graph says the > > same thing in real time? > > > > I would definitely start by doing a ping between radios and see if > > it's the wireless link versus ethernet/ports/etc. Last time I saw > > this, it was caused by a surge suppressor making the link go > > down/up super fast (I would get about 1 packet lost per 5 minutes). > > > > > > Josh Luthman > > Office: 937-552-2340 > > Direct: 937-552-2343 > > 1100 Wayne St > > Suite 1337 > > Troy, OH 45373 > > > > On Thu, Feb 22, 2018 at 3:34 PM, Kristian Hoffmann > > .com> wrote: > > > I wish these had a loopback test, because that would be an easy > > > way to find out. The wireless capacity during the events is a > > > nice straight line, so there's no indication that it's a wireless > > > problem, but that doesn't rule it out either. > > > > > > I'll run some tests pinging the radio itself at the same time, > > > and see if there's loss to the radio as well. > > > > > > Generally, OSPF is running over these links, but I've disabled > > > the OSPF instance and have the same results. > > > > > > -Kristian > > > > > > On Thu, 2018-02-22 at 08:18 -0500, Josh Luthman wrote: > > > > Definitely through the wireless link? Not including the > > > > Ethernet? > > > > > > > > Josh Luthman > > > > Office: 937-552-2340 > > > > Direct: 937-552-2343 > > > > 1100 Wayne St > > > > Suite 1337 > > > > Troy, OH 45373 > > > > > > > > On Feb 22, 2018 3:19 AM, "Blair Davis" > > > > wrote: > > > > > What routing protocols are you using across those links? > > > > > > > > > > -- > > > > > > > > > > > > > > > On 2/22/2018 1:54 AM, Kristian Hoffmann wrote: > > > > > > Hi, > > > > > > > > > > > > This is going to sound crazy, but here we go... > > > > > > > > > > > > Has anyone seen packet loss across an AF5x link that > > > > > occurred exactly > > > > > > every 30 seconds? I have a couple of links, on completely > > > > > different > > > > > > towers, that drop packets every 30 seconds. I can observe > > > > > it using the > > > > > > MikroTik traffic generator, or a fast ping (size=1500 > > > > > interval=.05). > > > > > > Even though they do it on a 30 second interval, it's not at > > > > > the same > > > > > > time (intervals are not synchronized). They're not bridged > > > > > together in > > > > > > any way, and even do it with no customer traffic on them > > > > > whatsoever. > > > > > > > > > > > > I've tried with and without flow control, every wireless > > > > > setting, > > > > > > with/without management vlan, firmware 4.0 and 4.0.3, etc. > > > > > As they're > > > > > > connected to RB3011's, I even disabled the MikroTik LCD, as > > > > > apparently > > > > > > that's a thing. It's a shot in the dark, but... anyone? > > > > > > > > > > > > Thanks, > > > > > > > > > > > > -Kristian > > > > > > ___ > > > > > > Ubnt_users mailing list > > > > > > Ubnt_users@wispa.org > > > > > > http://lists.wispa.org/mailman/listinfo/ubnt_users > > > > > > > > > > -- > > > > > West Michigan Wireless ISP > > > > > Allegan, Michigan 49010 > > > > > 269-686-8648 > > > > > > > > > > A Division of: > > > > > Camp Communication Services, INC > > > > > > > > > > ___ > > > > > Ubnt_users mailing list > > > > > Ubnt_users@wispa.org > > > > > http://lists.wispa.org/mailman/listinfo/ubnt_users > > > > > > > > > ___ > > > > Ubnt_users mailing list > > > > Ubnt_users@wispa.org > > > > http://lists.wispa.org/mailman/listinfo/ubnt_users > > > ___ > > > Ubnt_users mailing list > > > Ubnt_users@wispa.org > > > http://lists.wispa.org/mailman/listinfo/ubnt_users > > > > > > > ___ > > Ubnt_users mailing list > > Ubnt_users@wispa.org > > http://lists.wispa.org/mailman/listinfo/ubnt_users > > > > > -- > -RickG > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org > http://lists.wispa.org/mailman/listinfo/ubnt_users___ U
Re: [Ubnt_users] AF5x packet loss
Darn, was hoping for some news that might apply here but I'm not running OSPF (yet). Glad you found the issue and thanks for the update! On Wed, Feb 28, 2018 at 6:12 PM, Kristian Hoffmann wrote: > For the archives... > > The issue turned out to be an old PtP radio that was decommissioned, but > not removed from the tower. The ethernet interface of the radio would > start flapping during certain times of the day. That interface was > connected to a router on an interface still configured for OSPF. Every > time the interface flapped, it would trigged a topology change. The > frequency of the topology changes appeared to be causing sub-second bursts > of packet loss that occurred every 30 seconds. We found it by turning on > OSPF debug logging and tallying the number of topology changes by > originator ID. The one at the top of the list was our culprit. > > hth, > > -Kristian > > On Fri, 2018-02-23 at 03:23 -0500, RickG wrote: > > +1 on the darned surge protectors! > > On Thu, Feb 22, 2018 at 3:37 PM, Josh Luthman > wrote: > > Why do you need a loopback test when the capacity graph says the same > thing in real time? > > I would definitely start by doing a ping between radios and see if it's > the wireless link versus ethernet/ports/etc. Last time I saw this, it was > caused by a surge suppressor making the link go down/up super fast (I would > get about 1 packet lost per 5 minutes). > > > Josh Luthman > Office: 937-552-2340 > Direct: 937-552-2343 > 1100 Wayne St > Suite 1337 > Troy, OH 45373 > > On Thu, Feb 22, 2018 at 3:34 PM, Kristian Hoffmann > wrote: > > I wish these had a loopback test, because that would be an easy way to > find out. The wireless capacity during the events is a nice straight line, > so there's no indication that it's a wireless problem, but that doesn't > rule it out either. > > I'll run some tests pinging the radio itself at the same time, and see if > there's loss to the radio as well. > > Generally, OSPF is running over these links, but I've disabled the OSPF > instance and have the same results. > > -Kristian > > On Thu, 2018-02-22 at 08:18 -0500, Josh Luthman wrote: > > Definitely through the wireless link? Not including the Ethernet? > > Josh Luthman > Office: 937-552-2340 <(937)%20552-2340> > Direct: 937-552-2343 <(937)%20552-2343> > 1100 Wayne St > Suite 1337 > Troy, OH 45373 > > On Feb 22, 2018 3:19 AM, "Blair Davis" wrote: > > What routing protocols are you using across those links? > > -- > > > On 2/22/2018 1:54 AM, Kristian Hoffmann wrote: > > Hi, > > > > This is going to sound crazy, but here we go... > > > > Has anyone seen packet loss across an AF5x link that occurred exactly > > every 30 seconds? I have a couple of links, on completely different > > towers, that drop packets every 30 seconds. I can observe it using the > > MikroTik traffic generator, or a fast ping (size=1500 interval=.05). > > Even though they do it on a 30 second interval, it's not at the same > > time (intervals are not synchronized). They're not bridged together in > > any way, and even do it with no customer traffic on them whatsoever. > > > > I've tried with and without flow control, every wireless setting, > > with/without management vlan, firmware 4.0 and 4.0.3, etc. As they're > > connected to RB3011's, I even disabled the MikroTik LCD, as apparently > > that's a thing. It's a shot in the dark, but... anyone? > > > > Thanks, > > > > -Kristian > > ___ > > Ubnt_users mailing list > > Ubnt_users@wispa.org > > http://lists.wispa.org/mailman/listinfo/ubnt_users > > -- > West Michigan Wireless ISP > Allegan, Michigan 49010 > 269-686-8648 > > A Division of: > Camp Communication Services, INC > > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org > http://lists.wispa.org/mailman/listinfo/ubnt_users > > ___ > Ubnt_users mailing > listUbnt_users@wispa.orghttp://lists.wispa.org/mailman/listinfo/ubnt_users > > > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org > http://lists.wispa.org/mailman/listinfo/ubnt_users > > > > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org > http://lists.wispa.org/mailman/listinfo/ubnt_users > > > > > -- > -RickG > > ___ > Ubnt_users mailing > listUbnt_users@wispa.orghttp://lists.wispa.org/mailman/listinfo/ubnt_users > > > ___ > Ubnt_users mailing list > Ubnt_users@wispa.org > http://lists.wispa.org/mailman/listinfo/ubnt_users > > -- -RickG ___ Ubnt_users mailing list Ubnt_users@wispa.org http://lists.wispa.org/mailman/listinfo/ubnt_users
Re: [Ubnt_users] AF5x packet loss
House keeping. Phil On Wed, Feb 28, 2018 at 5:53 PM, RickG wrote: > Darn, was hoping for some news that might apply here but I'm not running > OSPF (yet). Glad you found the issue and thanks for the update! > > On Wed, Feb 28, 2018 at 6:12 PM, Kristian Hoffmann > wrote: > >> For the archives... >> >> The issue turned out to be an old PtP radio that was decommissioned, but >> not removed from the tower. The ethernet interface of the radio would >> start flapping during certain times of the day. That interface was >> connected to a router on an interface still configured for OSPF. Every >> time the interface flapped, it would trigged a topology change. The >> frequency of the topology changes appeared to be causing sub-second bursts >> of packet loss that occurred every 30 seconds. We found it by turning on >> OSPF debug logging and tallying the number of topology changes by >> originator ID. The one at the top of the list was our culprit. >> >> hth, >> >> -Kristian >> >> On Fri, 2018-02-23 at 03:23 -0500, RickG wrote: >> >> +1 on the darned surge protectors! >> >> On Thu, Feb 22, 2018 at 3:37 PM, Josh Luthman < >> j...@imaginenetworksllc.com> wrote: >> >> Why do you need a loopback test when the capacity graph says the same >> thing in real time? >> >> I would definitely start by doing a ping between radios and see if it's >> the wireless link versus ethernet/ports/etc. Last time I saw this, it was >> caused by a surge suppressor making the link go down/up super fast (I would >> get about 1 packet lost per 5 minutes). >> >> >> Josh Luthman >> Office: 937-552-2340 <(937)%20552-2340> >> Direct: 937-552-2343 <(937)%20552-2343> >> 1100 Wayne St >> Suite 1337 >> Troy, OH 45373 >> >> On Thu, Feb 22, 2018 at 3:34 PM, Kristian Hoffmann >> wrote: >> >> I wish these had a loopback test, because that would be an easy way to >> find out. The wireless capacity during the events is a nice straight line, >> so there's no indication that it's a wireless problem, but that doesn't >> rule it out either. >> >> I'll run some tests pinging the radio itself at the same time, and see if >> there's loss to the radio as well. >> >> Generally, OSPF is running over these links, but I've disabled the OSPF >> instance and have the same results. >> >> -Kristian >> >> On Thu, 2018-02-22 at 08:18 -0500, Josh Luthman wrote: >> >> Definitely through the wireless link? Not including the Ethernet? >> >> Josh Luthman >> Office: 937-552-2340 <(937)%20552-2340> >> Direct: 937-552-2343 <(937)%20552-2343> >> 1100 Wayne St >> Suite 1337 >> Troy, OH 45373 >> >> On Feb 22, 2018 3:19 AM, "Blair Davis" wrote: >> >> What routing protocols are you using across those links? >> >> -- >> >> >> On 2/22/2018 1:54 AM, Kristian Hoffmann wrote: >> > Hi, >> > >> > This is going to sound crazy, but here we go... >> > >> > Has anyone seen packet loss across an AF5x link that occurred exactly >> > every 30 seconds? I have a couple of links, on completely different >> > towers, that drop packets every 30 seconds. I can observe it using the >> > MikroTik traffic generator, or a fast ping (size=1500 interval=.05). >> > Even though they do it on a 30 second interval, it's not at the same >> > time (intervals are not synchronized). They're not bridged together in >> > any way, and even do it with no customer traffic on them whatsoever. >> > >> > I've tried with and without flow control, every wireless setting, >> > with/without management vlan, firmware 4.0 and 4.0.3, etc. As they're >> > connected to RB3011's, I even disabled the MikroTik LCD, as apparently >> > that's a thing. It's a shot in the dark, but... anyone? >> > >> > Thanks, >> > >> > -Kristian >> > ___ >> > Ubnt_users mailing list >> > Ubnt_users@wispa.org >> > http://lists.wispa.org/mailman/listinfo/ubnt_users >> >> -- >> West Michigan Wireless ISP >> Allegan, Michigan 49010 >> 269-686-8648 >> >> A Division of: >> Camp Communication Services, INC >> >> ___ >> Ubnt_users mailing list >> Ubnt_users@wispa.org >> http://lists.wispa.org/mailman/listinfo/ubnt_users >> >> ___ >> Ubnt_users mailing >> listUbnt_users@wispa.orghttp://lists.wispa.org/mailman/listinfo/ubnt_users >> >> >> ___ >> Ubnt_users mailing list >> Ubnt_users@wispa.org >> http://lists.wispa.org/mailman/listinfo/ubnt_users >> >> >> >> ___ >> Ubnt_users mailing list >> Ubnt_users@wispa.org >> http://lists.wispa.org/mailman/listinfo/ubnt_users >> >> >> >> >> -- >> -RickG >> >> ___ >> Ubnt_users mailing >> listUbnt_users@wispa.orghttp://lists.wispa.org/mailman/listinfo/ubnt_users >> >> >> ___ >> Ubnt_users mailing list >> Ubnt_users@wispa.org >> http://lists.wispa.org/mailman/listinfo/ubnt_users >> >> > > > -- > -RickG > > __
