Batch stuff like this, I tend to break into chunks, and call each chunk via a cfhttp call. (maybe 1000 records or so per chunk?)
That way you get a single request, that can be entirely gc'd after each request. Worked well for me in the past. Mark On Thu, Mar 10, 2011 at 10:26 AM, Michael Grant <mgr...@modus.bz> wrote: > > Good luck. > > On Wed, Mar 9, 2011 at 4:44 PM, <webmas...@pegweb.com> wrote: > > > > > Ok I tried this. I took all the flushes out but one so only one timer > > per loop and ran it over 5000 records. > > > > With all the flushes in place total execution time was 111905 ms > > With only one flush total execution time for the same query was 74622 ms > > > > A difference of a little over 37 seconds > > > > With no flushing at all total execution time was 70520 ms > > > > A total difference of a little over 41 seconds > > > > So it does appear the flushing is the cause of some of the slowdown. > > > > However I tried running the loop over 10k records and I run into this > > error > > > > GC overhead limit exceeded null > > > > I have increase my maximum heap size to 1500mb so will try again. :( > > > > -----Original Message----- > > From: Michael Grant [mailto:mgr...@modus.bz] > > Sent: Wednesday, March 09, 2011 4:12 PM > > To: cf-talk > > Subject: Re: Performance Issue with CFLOOP > > > > > > Are you sure it's actually the loop slowing down or is it your browser > > slowing down from all the cfflush-ing? Try removing the cfflush and > > track the time it takes by writing the execution time to an array then > > dump out the array after the loop completes and compare your results. > > That will at least help you narrow down if it's truly a problem with the > > loop. > > > > > > > > On Wed, Mar 9, 2011 at 4:03 PM, <webmas...@pegweb.com> wrote: > > > > > > > > Looking for any ideas here. > > > > > > > > > > > > I'm running a cfloop over a query from a database with a little over > > > 60,000 records in it on MSSQL. I am doing a cfflush so I can watch > > > what record it is on so I can keep up with how quickly or slowly the > > > loop is running. The problem is after about 4850ish records the loop > > > slows waaay down. Any idea why the speed change or how I can stop it > > from happening? > > > All I am doing is querying 2 columns and based on the data in those 2 > > > I am updating 3 other columns. So it looks up the data then loops over > > > > > it then updates each record with some new data. Runs great till about > > > 95% of the loop. Looking for any ideas out there. > > > > > > > > > > > > > > > > > > > > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:342871 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
