Ok, First of all...
If anyone has actually done what Grant is trying to do, then PLEASE look at it this way. Coldfusion is an interpreted language, when I did this on only a 5meg file all those years ago. Coldfusion would always timeout, no matter how long I made the timeout request for. Not only that, but it began chewing up more memory than it really needed to. (This was V5.0 coldfusion, and I know that it will be a bit faster on MX 6.0+) however speed is an issue as well. I ended up writing a C++ solution all those years ago, and the application ran in 20 minutes compared to 12 hours later and timing out on CF. There is a performance issue to consider here. And I am sorry but this sort of processing is not what coldfusion is about, this is where we as developers really need to say NO to CF in this case. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 -----Original Message----- From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED] Sent: Thursday, 14 June 2007 10:21 AM To: cfaussie@googlegroups.com Subject: [cfaussie] Re: Large CSV's and server timeouts On Thu, Jun 14, 2007 at 10:04:13AM +1000, Andrew Scott wrote: > Grant, > The most efficient way that I can think about of the top of my head, is to > write a .Net / C++ / Java application that will run and buffer read the > file. I came across this once before and the only solution is to write a > parser in a language that is able to file seek through the file. Take a look at: http://www.informationsavvy.com/coldfusion/ FileReader.cfc - "This ColdFusion Java CFC File Reader can be used to read files incrementally" However, this blog entry: http://tinyurl.com/2vrsqw claims CFHTTP is faster than Java Buffered in their tests. Try FileReader.cfc with your data and let us know how it turns out. Paul Haddon Technical Services Manager Formstar Print Technologies --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "cfaussie" group. To post to this group, send email to cfaussie@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/cfaussie?hl=en -~----------~----~----~----~------~----~------~--~---