[cfaussie] Re: OT: Outlook 2007 RSS Reader

Hi Dale, Double posts sometimes occur as a result of minor changes in posts: (1) you wrote a post and publish it, (2) found a typo and correct that post, but (3) feed reader already grab your post in between steps 1 and 2, as well as (4) feed reader grab your second post, even if GUID field

[cfaussie] Re: Large CSV's and server timeouts

Gosh what a response. Here's what we've found: - doing it on the coldfusion server timesout the server. this rules out cffile, cfx tags and such. - breaking it into chucks timed-out the server as well. performance didn't really alter when we changed the size of the chunks; sooner or later the serv

[cfaussie] DEADLOCK - HELP!

I can affirm that upgrading Data direct drivers help a lot. Current version is 3.7 >>> Andrew Scott <[EMAIL PROTECTED]> 14/06/2007 2:04 pm >>> Might be a stupid question, but have you tried wrapping a cftransaction around your insert? Or even a cflock? What version of CF are you using and ar

[cfaussie] Re: JRun and a war application

I eventually got Roller to work on Tom Cat.. And had a bit of spare time to try again on JRun. I find this in the log files, does anyone know what this means? All references that I have found seem to be KB's from 4-5 years old, but all relate to struts? Exception parsing the TLD null : The tag f

[cfaussie] Re: DEADLOCK - HELP!

Might be a stupid question, but have you tried wrapping a cftransaction around your insert? Or even a cflock? What version of CF are you using and are you using the standard macromedia DSN connectors, and not JDBC drivers? Have you also patched CF with the latest hotfixes, and macromedia JD

[cfaussie] Re: DEADLOCK - HELP!

Well I've been diving into the documentation and trying out some things. (READPAST) seemed to do it for now. Haven't obtained SQL Best practises yet. On 6/14/07, Scott Thornton <[EMAIL PROTECTED]> wrote: > > > How are you going with this? > > PS: I would try removing SET DEADLOCK_PRIORITY LOW;

[cfaussie] REMINDER 4 TONIGHT [QLD CFUG this week: Hidden treasure found! ... (general)]

yes, it's on tonight. (those who have already sent RSVP's, many thanks) > Avast me hearties! > > With Captain Charile Arehart at the helm we'll be sailin' in uncharted > waters looking for buried treasure. Arrr... > > Forget yer fancy Golden Fleece, we'd be after the "Hidden Gems of > ColdFusion

[cfaussie] Re: CFAussie Community Head Count

bling bling bling reprazent! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "cfaussie" group. To post to this group, send email to cfaussie@googlegroups.com To unsubscribe from this group, send email to [EMAIL PRO

[cfaussie] Re: Large CSV's and server timeouts

that's all good stuff! working with files has been an issue with CF for a while now... Dale Fraser wrote: > FileRead also has a buffer size so you can get bits at a time. > > Regards > Dale Fraser > > http://dalefraser.blogspot.com > > > -Original Message- > From: cfaussie@googlegroups.c

[cfaussie] Re: Large CSV's and server timeouts

Steve, You might have missed it, but CF8 went public beta :) Regards Dale Fraser http://dalefraser.blogspot.com -Original Message- From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of Steve Onnis Sent: Thursday, 14 June 2007 11:40 AM To: cfaussie@googlegroups.com Sub

[cfaussie] Re: Large CSV's and server timeouts

FileRead also has a buffer size so you can get bits at a time. Regards Dale Fraser http://dalefraser.blogspot.com -Original Message- From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of Andrew Scott Sent: Thursday, 14 June 2007 11:17 AM To: cfaussie@googlegroups.com S

[cfaussie] Re: Large CSV's and server timeouts

No, There are new file tags, lots of them and they will help you. FileClose, FileIsEOF, FileOpen, FileRead, FileReadBinary, FileReadLine, FileWrite, and FileWriteLine. Specifically look at myfile = FileOpen("c:\ColdFusionScorpio\wwwroot\test1.txt", "read"); while(NOT FileisEOF(myfile)) { x =

[cfaussie] Re: Large CSV's and server timeouts

Hello, grant wrote: > Here's the scenario: we have a csv file that contains 1.5 million rows > and is provided by an external vendor. we need to either (a) parse the > csv and insert into a DB, or (b) do lookups directly on the csv. Coming in a bit late on this. The fact that there are CFXs th

[cfaussie] Re: Large CSV's and server timeouts

Steve. Coldfusion 8 is public Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 -Original Message- From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of Steve Onnis Sent: Thursday, 14 June 2007 11

[cfaussie] Re: Large CSV's and server timeouts

Actually I would take it to mean that it doesn't load the entire file.. So that is good to know, but a quick test wouldn't hurt. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 -Original Message- From: cfaussie@

[cfaussie] Re: Large CSV's and server timeouts

NDA on the publicly available BETA and Docs? On Jun 14, 1:40 pm, "Steve Onnis" <[EMAIL PROTECTED]> wrote: > NDA peoples NDA... > > -Original Message- > From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf > > Of Andrew Scott > Sent: Thursday, 14

[cfaussie] Re: Large CSV's and server timeouts

NDA peoples NDA... -Original Message- From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of Andrew Scott Sent: Thursday, 14 June 2007 11:17 AM To: cfaussie@googlegroups.com Subject: [cfaussie] Re: Large CSV's and server timeouts Doh, I thoug

[cfaussie] Re: Large CSV's and server timeouts

hmmm I guess I was reading that it doesn't load it in to memory, as the last line in the docs say "ColdFusion closes the file." ...but you are right, it doesn't actually say it doesn't load the entire file... may be time for some testing later on to find out! Andrew Scott wrote: > Doh, > > I th

[cfaussie] Re: Large CSV's and server timeouts

Doh, I thought you were talking about cfloop:-) Anyway, I am assuming that it loads it into memory to process. But really thinking about it, that would be a very hungry way of doing that new feature. So I hope I am wrong.. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.co

[cfaussie] Re: Saving a pushed ZIP file

When using CFHTTP to get a file, there is a "getasbinary" attribute. Try setting this to "true" and see if it helps... Andrew Scott wrote: > Steve, > > I think you might be right, but I can't say that I have done what you are > doing. But cffile should be able to save it has a binary under normal

[cfaussie] Re: Large CSV's and server timeouts

After a quick check, I am thinking of CFLOOP. CFLOOP now has a "file" attritbute. In CF8 Docs: == Attribute: "file" (Optional) The absolute path and filename of the text file to read, one line at a time. This is helpful when reading large text files, because

[cfaussie] Re: Saving a pushed ZIP file

Steve, I think you might be right, but I can't say that I have done what you are doing. But cffile should be able to save it has a binary under normal circumstances. But with CFHTTP it might be seen as a character/byte stream rather than a binary stream. Wouldn't hurt to try saving it as a binar

[cfaussie] Re: Saving a pushed ZIP file

Yeh just HTTP The current process pushes the file to the browser for download. What I am trying to do it let CFHTTP pull the file down, read the CFHTTP.fileContent data, write it to the file system, unzip the ZIP file and process the CSV file in it. I am just not sure if I need to write the fil

[cfaussie] Re: Large CSV's and server timeouts

Hmm... That might be a good question.. You could be right on that, never tried that new feature as of yet. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 -Original Message- From: cfaussie@googlegroups.com [mailt

[cfaussie] Re: Large CSV's and server timeouts

Cool, I haven't tried it since the good old CF 5.0 daysJ But I did find a difference in speed in the processing. But then again, I had to traverse over a month of these files. And after 5 days had gotten no where fast, till I bit the bullet wrote my C++ application ran it then had the files

[cfaussie] Re: Large CSV's and server timeouts

>From Charlie A's presentation of "Hidden Gems" I got the impression that CF8 can loop over a file without loading it completely in to memory... I'll look in to it and let you know, unless someone else knows for sure already? Andrew Scott wrote: > Actually wouldn't say they are new functions...

[cfaussie] Re: Large CSV's and server timeouts

Could you set the file up as a TEXT datasource? Similar to if you were setting up a XLS file? [Windows] Administrator Tools > ODBC Datasources Add it in there to use the TEST driver and maybe you can then set up a CF datasource to query they file directly. Not sure on performance but maybe th

[cfaussie] Re: Large CSV's and server timeouts

Hi Andrew, some of the smaller files we handle are in the order of 5 meg and larger files have been in the order of 12 meg ...we have had major issues with servers timing out on large files - CSV and the dreadful XLS files - depending on who created the files even became a factor i.e errors wi

[cfaussie] Re: Large CSV's and server timeouts

Actually wouldn't say they are new functions... Unless I am missing something? But yes you can now loop over a file using cfloop, but the problem is that has to be in memory. And cffile can now process files line by line. However, all things aside when you deal with a large file CF is very

[cfaussie] Re: OT: Outlook 2007 RSS Reader

Dale, I began / tried to use the RSS feed in Outlook and had to many issues with it, ended up going back to IE7's way of reading RSS feeds instead. One of the main issues I had was similar to yours, but I also when an update occurred for outlook 2007 ended up with multiple RSS folders (And I cou

[cfaussie] Re: Large CSV's and server timeouts

Not sure if this is an option. But CF8 has new file functions that do incremental reads also. Regards Dale Fraser http://dalefraser.blogspot.com From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of Andrew Scott Sent: Thursday, 14

[cfaussie] Re: Large CSV's and server timeouts

Ok, First of all... If anyone has actually done what Grant is trying to do, then PLEASE look at it this way. Coldfusion is an interpreted language, when I did this on only a 5meg file all those years ago. Coldfusion would always timeout, no matter how long I made the timeout request for. Not onl

[cfaussie] Re: Large CSV's and server timeouts

can you use cfsetting and increase the timeout massively for that request to stop the timeout? If you are reading in a huge file, cffile is not good, as it can will read in the entire file to memory (I understand this has been imporved in CF8) The is an example of using Java to read in a file li

[cfaussie] Re: Large CSV's and server timeouts

Rob, I doubt CF will be able to handle a query of this magnitude that grant is looking at, but to split the file up into 1mg chunks could be viable. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 From: cfaussie@g

[cfaussie] Re: Large CSV's and server timeouts

Grant, That's why I thought I would add that there might be an application already out there, I can't be 100% sure but I have seen apps that have been able to manipulate CSV files (IIS Server log files in particular) but whether they will do what you are looking at doing then that I can't answe

[cfaussie] Re: Large CSV's and server timeouts

On Thu, Jun 14, 2007 at 10:04:13AM +1000, Andrew Scott wrote: > Grant, > The most efficient way that I can think about of the top of my head, is to > write a .Net / C++ / Java application that will run and buffer read the > file. I came across this once before and the only solution is to write a

[cfaussie] Re: OT: Outlook 2007 RSS Reader

Happing for me regularly with Ray & Ben's blog and others. Regards Dale Fraser http://dalefraser.blogspot.com -Original Message- From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of Justin Carter Sent: Thursday, 14 June 2007 9:55 AM To: cfaussie Subject: [cfaussie] Re:

[cfaussie] Re: Large CSV's and server timeouts

Hi Grant, we have used http://www.emerle.net/programming/display.cfm/t/cfx_text2query with success Cheers Rob _ From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of grant Sent: Thursday, 14 June 2007 9:54 AM To: cfaussie@googlegroups.com Subject: [cfaussie] Large C

[cfaussie] Re: Large CSV's and server timeouts

Thanks Andrew. That's actually the path we're heading down (a custom java app); I thought I'd post here to ensure we're not re-inventing the wheel... Thanks! On 14/06/07, Scott Thornton <[EMAIL PROTECTED]> wrote: > > > Perhaps you could import it into MS Access (by hand) then into Oracle. I > am

[cfaussie] Re: Large CSV's and server timeouts

Perhaps you could import it into MS Access (by hand) then into Oracle. I am a MS SQL user myself so I do not know what oracle tools there are available. >>> grant <[EMAIL PROTECTED]> 14/06/2007 9:53 am >>> Hi y'All Here's the scenario: we have a csv file that contains 1.5 million rows and is

[cfaussie] Re: Large CSV's and server timeouts

Grant, The most efficient way that I can think about of the top of my head, is to write a .Net / C++ / Java application that will run and buffer read the file. I came across this once before and the only solution is to write a parser in a language that is able to file seek through the file.

[cfaussie] Re: OT: Outlook 2007 RSS Reader

I often seem to get this from a number of Microsoft blogs (IE, Vista, Home Server, etc) but it doesn't happen with any others that I can think of... I never worked out exactly why though, it's only happened a few times so it hasn't bothered me that much - I just right clicked on the folder and cho

[cfaussie] Large CSV's and server timeouts

Hi y'All Here's the scenario: we have a csv file that contains 1.5 million rows and is provided by an external vendor. we need to either (a) parse the csv and insert into a DB, or (b) do lookups directly on the csv. We do not and cannot have SQLloader. The DB is ORA10g. The servers are old and un

[cfaussie] Re: DEADLOCK - HELP!

How are you going with this? PS: I would try removing SET DEADLOCK_PRIORITY LOW; >>> "Taco Fleur" <[EMAIL PROTECTED]> 13/06/2007 2:31 pm >>> Hi All, Platform: MS SQL 2005 I have a simple SQL statement that simply logs a bit of data, nothing important at all. SET DEADLOCK_PRIORITY LOW

[cfaussie] OT: Outlook 2007 RSS Reader

This is OT but people here probably in the same boat. I'm using Outlook 2007 as a RSS Reader, and can't work out why sometimes, I entries twice. Strange thing is, it's not all the time, any clues? Regards Dale Fraser http://dalefraser.blogspot.com --~--~-~--~~-

[cfaussie] Re: Saving a pushed ZIP file

Don't think you should have to do anything special. How is the file being sent? Over HTTP? On 6/14/07, Steve Onnis <[EMAIL PROTECTED]> wrote: > > I am trying to save a zip file that is being provided from another server > but when I am writing it to the system the zip file is saved, the file in i

[cfaussie] Saving a pushed ZIP file

I am trying to save a zip file that is being provided from another server but when I am writing it to the system the zip file is saved, the file in it is there but the zipped file is zero bytes and corrupted. Is there a certain way you have to save these types of compressed file? Steve Onnis

[cfaussie] Re: Safari for window

My understanding is the Safari is very strict (better than FF, IE) on CSS, so anything that is not cross browser compliant will break on Safari that is 100% for sure. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 -

[cfaussie] Re: Safari for window

No, I can browse any website with my installation of Safari with no problem at all. But most of websites looks a bit crappy -- lists are broken, colours inverted, hyperlinks disappears, etc. -- although I definitely know that some of them were built using MacOS Safari in first instance. Best reg

[cfaussie] Re: Safari for window

Yeah, He is not the only one. I like their strategy though, release a browser that can only see the apple home page. Captive audience. Regards Dale Fraser http://dalefraser.blogspot.com -Original Message- From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of Haikal S