AVC – turn it off. If you’re using older model WAPs, AVC imparts a high cost on the controllers. On newer WAPs like the 3800, AVC is hardware accelerated.
If you are going to run 8.2, MR5 is due any day now and you’ll want the new release. Jeff From: "wireless-lan@listserv.educause.edu" <WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU> on behalf of Jake Snyder <jsnyde...@gmail.com> Reply-To: "wireless-lan@listserv.educause.edu" <WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU> Date: Wednesday, March 8, 2017 at 10:13 PM To: "wireless-lan@listserv.educause.edu" <WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU> Subject: Re: [WIRELESS-LAN] Cisco 8510 8.2 Load Issues Might try leaving it off and see if that improves things. Just sounds oddly familiar. Make sure you disable it on all SSIDs to make sure you get a fair test with it off. Sent from my iPhone On Mar 8, 2017, at 10:56 PM, Jason Cook <jason.c...@adelaide.edu.au<mailto:jason.c...@adelaide.edu.au>> wrote: We don’t use it, but yes looking at our SSID config under QOS AVC is enabled on. Is this the only place to enable it? Per SSID? This would seem a good thing to kill off, clearly I should have paid more attention to that discussion last year looking at history. Thanks Jake I’m now cringing a bit if this is the fix. Oh well. Gotta learn one way or another -- Jason Cook Technology Services The University of Adelaide, AUSTRALIA 5005 Ph : +61 8 8313 4800 From: The EDUCAUSE Wireless Issues Constituent Group Listserv [mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU] On Behalf Of Jake Snyder Sent: Thursday, 9 March 2017 4:08 PM To: WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU<mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU> Subject: Re: [WIRELESS-LAN] Cisco 8510 8.2 Load Issues I hate to ask, but do you have AVC enabled? Sent from my iPhone On Mar 8, 2017, at 9:59 PM, Watters, John <john.watt...@ua.edu<mailto:john.watt...@ua.edu>> wrote: I'll check the load on our most loaded 8510 HA pair in the morning & get back to you. It is about 2300-2500 APs with at least that many concurrent clients. Running 8.0.140.0 though (we moved there from a 7.6 (126 ?) level and Cisco recommended that we move to 8.0.140 before going on up to 8.3). We just bought a new 8510HA pair for this same MPLS area to divide the load. It is running, but has no load at all yet. Was thinking of starting it on 8.3 code. So, I am very interested in your problem and tghe solution. Please be sure to post it. ========================== -jcw ________________________________ From: The EDUCAUSE Wireless Issues Constituent Group Listserv <WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU<mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU>> on behalf of Jason Cook <jason.c...@adelaide.edu.au<mailto:jason.c...@adelaide.edu.au>> Sent: Wednesday, March 8, 2017 10:28:09 PM To: WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU<mailto:WIRELESS-LAN@LISTSERV.EDUCAUSE.EDU> Subject: [WIRELESS-LAN] Cisco 8510 8.2 Load Issues Hi All, Just wondering if anyone has had an similar experiences to the fun we’ve had the last week or so. Towards the end of last year we moved to new 8510 HA pair on 8.2.121.11 (we had an issue in testing at the time so grabbed the latest ER release that resolved a crash bug) From 5x5508’s in N+1 on 8.0.121.0 code We started before the end of term with a small number of locations but didn’t fully load it up until the big break. Now the students are back and needing there internet we have had some real load issues during the day. SO it’s 2x 8510’s in HA about 2100 AP’s peaking at about 14k concurrent clients but the issue seems to creep in at about 10k. While ICMP isn’t the greatest tool for performance it does line up here, the graph below show around 10am we see increased delays in response to the vlan42 (client network) interface on the controller and we see this on its management interface too. At this point our clients ICMP to its own gateway starts to increase from 1-3ms to 400-600 and even upto 1800 when the big spike shows 800ms to the interface. Iperf testing will also go from 100Mb down to 1-5 and even 0 at times. With users complaining of slowness and it’s worse unable to login. CPU/Memory resources, channel util etc all ok. It’s site wide impact to users no matter if it’s HD rf design or what AP model (1142, 2702,3702,3502 etc) So seems in the controller itself. All testing done on 5hz Around midday we started migrating AP’s away to our old 5508’s, which saw a significant drop just before 12:30 and things back to normal at 12:40 once 300AP’s were moved off. So for now users are happy, apparently we’ve even had callers in saying how good it is today (must have been bad the last week for that to happen). Controller response to SNMP was so bad it was taking Prime 2 minutes per AP to re-configure primary controller. Did it by hand, ssh/gui response was not it’s normal self but no problem. The 5508’s have shown no signs of being unhappy with about 150 AP’s each. We are working with TAC who have been good and they are investigating(no like cases found though), shedding the load has worked around the issue but it needs fixing. We upgraded to 8.2.141.0 yesterday evening but won’t be re-loading the 8510’s until next week so confirming it’s fixed is a few days off. There’s a few short upto 30ms delayed ICMP responses today but it’s hard to know if that’s related or just the nature of icmp and network gear priority. Interested to know if anyone has seen anything like this in their environment. And anyone if anyone out there is using 8510’s in HA what’s your load in AP and concurrent users? I can imagine many places loading their devices up more than us Anyone know how to look at other hardware resources (not CPU/memory/system buffers) Something like ASIC on switches if it exists. Surely all this traffic isn’t cpu Thanks Jason <image001.jpg> -- Jason Cook Technology Services The University of Adelaide, AUSTRALIA 5005 Ph : +61 8 8313 4800 e-mail: jason.c...@adelaide.edu.au<mailto:jason.c...@adelaide.edu.au<mailto:jason.c...@adelaide.edu.au%3cmailto:jason.c...@adelaide.edu.au>> CRICOS Provider Number 00123M ----------------------------------------------------------- This email message is intended only for the addressee(s) and contains information which may be confidential and/or copyright. If you are not the intended recipient please do not read, save, forward, disclose, or copy the contents of this email. If this email has been sent to you in error, please notify the sender by reply email and delete this email and any copies or links to this email completely and immediately from your system. No representation is made that this email is free of viruses. Virus scanning is recommended and is the responsibility of the recipient. ********** Participation and subscription information for this EDUCAUSE Constituent Group discussion list can be found at http://www.educause.edu/discuss. ********** Participation and subscription information for this EDUCAUSE Constituent Group discussion list can be found at http://www.educause.edu/discuss. ********** Participation and subscription information for this EDUCAUSE Constituent Group discussion list can be found at http://www.educause.edu/discuss. ********** Participation and subscription information for this EDUCAUSE Constituent Group discussion list can be found at http://www.educause.edu/discuss. ********** Participation and subscription information for this EDUCAUSE Constituent Group discussion list can be found at http://www.educause.edu/discuss. ********** Participation and subscription information for this EDUCAUSE Constituent Group discussion list can be found at http://www.educause.edu/discuss.
