Hello Greg, Don't forget that IIS and most web servers can throttle the output. I worked in an environment where we would have users loading small text files to extremely large (> 300 MB) and it takes time for the web server to upload it. A 10 MB file would take about 600 to 700 seconds for it to load; and this was all on an private internal network with an ATM backbone.
On a side note, it was probably one of the largest intranets that I have ever worked on. At last check, it was hosting close to 3.4 million reports that took up about 4.5 Terabytes of storage space. We used an IBM Shark for the SAN. All this thanks to HIPAA and internal company requirements. %^) Russell ----- Original Message ----- From: "Greg Morphis" <[EMAIL PROTECTED]> To: "CF-Talk" <[EMAIL PROTECTED]> Sent: Monday, November 22, 2004 4:31 PM Subject: Re: Write large amount of data to text.. > Man this is messed up... the Dev server can create this file load > 11,000+ rows (it's a 10 MB text file) in close to 10 seconds. > The Prod server takes 30 seconds for the query and 660 for loading the > text file.. if it loads it.. > Is this possibly due to the load from people/users on the Prod server? > > > > On Mon, 22 Nov 2004 12:24:52 -0600, Greg Morphis <[EMAIL PROTECTED]> > wrote: >> Thanks guys! >> I went with >> <cffile action="WRITE" file="#g_EcountFileDirectory#\#eCountFilename#" >> output="#ecount_header#" addnewline="Yes"> >> <cfloop query="fetchReferrals"> >> <cffile action="APPEND" >> file="#g_EcountFileDirectory#\#eCountFilename#" output="#record_data#" >> addnewline="Yes"> >> </cfloop> >> <cffile action="APPEND" >> file="#g_EcountFileDirectory#\#eCountFilename#" >> output="#ecount_footer#" addnewline="Yes"> >> >> Still takes a few minutes but it didnt crap out on me this time. >> Thanks! >> >> >> >> >> On Mon, 22 Nov 2004 10:03:29 -0800, Ian Skinner >> <[EMAIL PROTECTED]> wrote: >> > This won't help with your timeout issue, but you can see how far you >> > are getting. >> > >> > <cfloop query="fetchReferrals"> >> > <cfif fetchReferrals.currentRow EQ 1> >> > <cffile action="WRITE" >> > file="#g_EcountFileDirectory#\#eCountFilename#" >> > output="#ecount_header##ecount_file##ecount_footer#" addnewline="Yes"> >> > <cfelse> >> > <cffile action="APPEND" file="#g_EcountFileDirectory#\#eCountFilename#" >> > output="#ecount_header##ecount_file##ecount_footer#" addnewline="Yes"> >> > </cfif> >> > >> > This would at least write out each row. Give you an idea of how much >> > you need to increase your timeout in the administrator to allow this >> > process to run. >> > >> > -------------- >> > Ian Skinner >> > Web Programmer >> > BloodSource >> > www.BloodSource.org >> > Sacramento, CA >> > >> > "C code. C code run. Run code run. Please!" >> > - Cynthia Dunning >> > >> > Confidentiality Notice: This message including any >> > attachments is for the sole use of the intended >> > recipient(s) and may contain confidential and privileged >> > information. Any unauthorized review, use, disclosure or >> > distribution is prohibited. If you are not the >> > intended recipient, please contact the sender and >> > delete any copies of this message. >> > >> > >> > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Special thanks to the CF Community Suite Gold Sponsor - CFHosting.net http://www.cfhosting.net Message: http://www.houseoffusion.com/lists.cfm/link=i:4:185084 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4 Donations & Support: http://www.houseoffusion.com/tiny.cfm/54
