Excellent... it's always those vendors eh? :) Mark Kruger - CFG CF Webtools www.cfwebtools.com www.coldfusionmuse.com O: 402.932.3318 E: mkru...@cfwebtools.com Skype: markakruger
-----Original Message----- From: Paul Vernon [mailto:paul.ver...@web-architect.co.uk] Sent: Friday, June 14, 2013 10:04 AM To: cf-talk Subject: RE: What would you call high traffic for CF8 standard? Just to round this off. It seems I've solved the issue today. Thankfully. It turns out one of the ATS vendors has been posting jobs en-masse repeatedly at a rate of a few thousand per minute. There are only 4,500 jobs but they're repeatedly posting the same jobs over and over and over again all the time. The import routine is based on a web service and accepts job postings and queue's them for processing at a later time. The queue processing then occurs every 9 minutes and it processes posts at a time either inserting or updating existing jobs in the system. The queue processor makes use of cflock to ensure only one processor can run at once and it then runs until all jobs are imported. If another instance is run via the scheduled task, it fails due to the cflock which is in place. It turns out that the volume of posts the import process was processing meant it was pretty much running constantly. I've temporarily paused the import routines and stopped accepting posts to see what the performance difference is on the server. It's quite dramatic. Where I was seeing 1.2 million queries every 5 minutes I'm now seeing 250,000 queries in 5 minutes. The CPU processor load has reduced significantly and the page count which includes the cfc based web service has returned to much more sensible levels. I've raised a ticket with the relevant vendor to ensure that they only post new and updated jobs as per the original specification rather than sending everything all the time. Hopefully they will resolve the issue shortly. Thanks for all the assistance and offers of help both on and off list. Paul ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355942 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
