Chris, You're cfhttp-ing to the file so it might not be local to you, but if it is and if you're on CF5 try to make a dynamic datasource connection to the .txt file and query it that way.
I don't know the syntax for a .txt cfquery connectstring attribute off the top of my head - sorry, t ********************************************************************** Tyler M. Fitch Certified Advanced ColdFusion 5 Developer http://isitedesign.com ********************************************************************** -----Original Message----- From: Chris Giminez [mailto:[EMAIL PROTECTED]] Sent: Thursday, January 24, 2002 4:10 PM To: CF-Talk Subject: extracting data from a huge text file I'm trying to retrieve data and put it into a database from a text file. The text file is over 100MB with (I'm guessing) around 260,000 records, each record contains 85 fields. I tried to create a conditional loop at each line break, which works fine if I am working on a smaller version of the file, but chokes on the 100MB monster. Is there a more efficient way to deal with this other than looping through it or is there a way to break this file up into smaller chunks and deal with it piece by piece? I tried using cfhttp and that didn't work. I think the format of the data is not suitable for that. Below is a sample of two records. miamimls","FL","M805531","1003958","MAJESTIC PROPERTIES INC","3055341999","",",","","","","","","M","","","A","459000","","FL"," ","","","","","","","Miami Beach","Y22391","33139","","42","DADE","12025","","THE SUNDANCE","0","","","","","1612","2","2","2","","","","","","","","","", "","","","","","THE SUNDANCE","00-42-00-000-0006","0","0","0","","0","","","","","","","","" ,"","","","","","","","","", "","T16" "miamimls","FL","F425895","620406","P C REALTY","9545818853","",",","","","","","","M","","","A","36000","","FL" ,"","","","","","","","Sunri se","Y23056","33322","","3850","BROWARD","12011","","SUNRISE LAKES","80","","","","","","2","2","2","","","","","","","","","","","", "","","","SUNRISE LAKES 60 CONDO UNIT 302","494129AA0260","666","1","29","","","","","","","","","","","",""," ","","","","","","","","C05, E05,J02,J07,M01,M05,N02,N13,Q08,T11,U01,W30,X35" any suggestions would be very much appreciated. Chris ______________________________________________________________________ Why Share? Dedicated Win 2000 Server · PIII 800 / 256 MB RAM / 40 GB HD / 20 GB MO/XFER Instant Activation · $99/Month · Free Setup http://www.pennyhost.com/redirect.cfm?adcode=coldfusionc FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
