This sounds like a good solution. Do you just call the same page over and over with the cfhttp at the bottom passing a record variable until you reach the end of file or you doing something different?
-----Original Message----- From: Mark Mandel [mailto:mark.man...@gmail.com] Sent: Wednesday, March 09, 2011 9:03 PM To: cf-talk Subject: Re: Performance Issue with CFLOOP Batch stuff like this, I tend to break into chunks, and call each chunk via a cfhttp call. (maybe 1000 records or so per chunk?) That way you get a single request, that can be entirely gc'd after each request. Worked well for me in the past. Mark On Thu, Mar 10, 2011 at 10:26 AM, Michael Grant <mgr...@modus.bz> wrote: > > Good luck. > > On Wed, Mar 9, 2011 at 4:44 PM, <webmas...@pegweb.com> wrote: > > > > > Ok I tried this. I took all the flushes out but one so only one > > timer per loop and ran it over 5000 records. > > > > With all the flushes in place total execution time was 111905 ms > > With only one flush total execution time for the same query was > > 74622 ms > > > > A difference of a little over 37 seconds > > > > With no flushing at all total execution time was 70520 ms > > > > A total difference of a little over 41 seconds > > > > So it does appear the flushing is the cause of some of the slowdown. > > > > However I tried running the loop over 10k records and I run into > > this error > > > > GC overhead limit exceeded null > > > > I have increase my maximum heap size to 1500mb so will try again. :( > > > > -----Original Message----- > > From: Michael Grant [mailto:mgr...@modus.bz] > > Sent: Wednesday, March 09, 2011 4:12 PM > > To: cf-talk > > Subject: Re: Performance Issue with CFLOOP > > > > > > Are you sure it's actually the loop slowing down or is it your > > browser slowing down from all the cfflush-ing? Try removing the > > cfflush and track the time it takes by writing the execution time to > > an array then dump out the array after the loop completes and compare your results. > > That will at least help you narrow down if it's truly a problem with > > the loop. > > > > > > > > On Wed, Mar 9, 2011 at 4:03 PM, <webmas...@pegweb.com> wrote: > > > > > > > > Looking for any ideas here. > > > > > > > > > > > > I'm running a cfloop over a query from a database with a little > > > over > > > 60,000 records in it on MSSQL. I am doing a cfflush so I can watch > > > what record it is on so I can keep up with how quickly or slowly > > > the loop is running. The problem is after about 4850ish records > > > the loop slows waaay down. Any idea why the speed change or how I > > > can stop it > > from happening? > > > All I am doing is querying 2 columns and based on the data in > > > those 2 I am updating 3 other columns. So it looks up the data > > > then loops over > > > > > it then updates each record with some new data. Runs great till > > > about 95% of the loop. Looking for any ideas out there. > > > > > > > > > > > > > > > > > > > > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:342875 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm