FYII, FusionReactor would have shown you that right away as you would have seen all the web service requests running.
On Fri, Jun 14, 2013 at 4:04 PM, Paul Vernon < paul.ver...@web-architect.co.uk> wrote: > > Just to round this off. It seems I've solved the issue today. Thankfully. > > It turns out one of the ATS vendors has been posting jobs en-masse > repeatedly at a rate of a few thousand per minute. There are only 4,500 > jobs > but they're repeatedly posting the same jobs over and over and over again > all the time. > > The import routine is based on a web service and accepts job postings and > queue's them for processing at a later time. The queue processing then > occurs every 9 minutes and it processes posts at a time either inserting or > updating existing jobs in the system. > > The queue processor makes use of cflock to ensure only one processor can > run > at once and it then runs until all jobs are imported. If another instance > is > run via the scheduled task, it fails due to the cflock which is in place. > > It turns out that the volume of posts the import process was processing > meant it was pretty much running constantly. > > I've temporarily paused the import routines and stopped accepting posts to > see what the performance difference is on the server. It's quite dramatic. > > Where I was seeing 1.2 million queries every 5 minutes I'm now seeing > 250,000 queries in 5 minutes. The CPU processor load has reduced > significantly and the page count which includes the cfc based web service > has returned to much more sensible levels. > > I've raised a ticket with the relevant vendor to ensure that they only post > new and updated jobs as per the original specification rather than sending > everything all the time. Hopefully they will resolve the issue shortly. > > Thanks for all the assistance and offers of help both on and off list. > > Paul > > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:355938 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
