Re: Bulk data loading

2006-09-08 Thread Aaron Rouse
Maybe I have been lucky but I have found sql loader to be an incredibly easy tool to use for this need. On 9/6/06, Douglas Knudsen [EMAIL PROTECTED] wrote: yes. You can even do this 1) have user upload cvs file 2) use sqlloader called via cfexecute to load the data into the DB This will

RE: Bulk data loading

2006-09-06 Thread Ray Champagne
This is something that the database should do, not CF. Not being an Oracle guy, I can't tell you what that is, but it has been discussed here recently. (Hint. :) ) Anyways, you're looking for whatever Oracle's equivalent is to MSSQL's DTS. That should at least get you on the right track. Ray

Re: Bulk data loading

2006-09-06 Thread Claude Schneegans
Does anyone have a tested method of uploading bulk data to a database? Just set a datasource using the Microsoft Excel ODBC driver and query in the data. -- ___ REUSE CODE! Use custom tags; See http://www.contentbox.com/claude/customtags/tagstore.cfm

Re: Bulk data loading

2006-09-06 Thread Matt Robertson
You're talking about a CSV right? What amounts to a simple list, but with zillions of rows? The trick I found to getting this done (which the good folks here helped with enormously) is to use java to read each line incrementally rather than having cffile try to scarf down the whole file into

RE: Bulk data loading

2006-09-06 Thread Ray Champagne
Well, yea, I guess, depending on the size of this spreadsheet, this would work just as well. Chris, how large is this Excel sheet? -Original Message- From: Claude Schneegans [mailto:[EMAIL PROTECTED] Sent: Wednesday, September 06, 2006 2:31 PM To: CF-Talk Subject: Re: Bulk data

Re: Bulk data loading

2006-09-06 Thread Rick Root
Matt Robertson wrote: You're talking about a CSV right? What amounts to a simple list, but with zillions of rows? The trick I found to getting this done (which the good folks here helped with enormously) is to use java to read each line incrementally rather than having cffile try to scarf

Re: Bulk data loading

2006-09-06 Thread Rick Root
Rick Root wrote: I blogged the method at www.opensourcecf.com =) specifically... http://www.opensourcecf.com/1/2006/07/Reading-large-files-with-java-versus-CFFILE.cfm ~| Introducing the Fusion Authority Quarterly Update. 80

Re: Bulk data loading

2006-09-06 Thread Craig Drabik
Does anyone have a tested method of uploading bulk data to a database? I have a need (annually) for the admin person to be able to take data from an Excel spreadsheet and have it inserted into an Oracle database. Any sample code would be greatly appreciated. I've played with a CFC that makes

Re: Bulk data loading

2006-09-06 Thread Chris Tilley
is this Excel sheet? -Original Message- From: Claude Schneegans [mailto:[EMAIL PROTECTED] Sent: Wednesday, September 06, 2006 2:31 PM To: CF-Talk Subject: Re: Bulk data loading Does anyone have a tested method of uploading bulk data to a database? Just set a datasource using

Re: Bulk data loading

2006-09-06 Thread Joseph Lamoree
On 6 Sep 2006, at 11:19, Chris Tilley wrote: Does anyone have a tested method of uploading bulk data to a database? I have a need (annually) for the admin person to be able to take data from an Excel spreadsheet and have it inserted into an Oracle database. Any sample code would be

Re: Bulk data loading

2006-09-06 Thread Chris Tilley
I've tried it but getting an error message: 12:52:15.015 - Expression Exception - in D:\Inetpub\cf\WorkingCapitalFund\FileReader.cfc : line 65 Variable RETURNSTRING is undefined. Any ideas why? On 9/6/06, Rick Root [EMAIL PROTECTED] wrote: Rick Root wrote: I blogged the

Re: Bulk data loading

2006-09-06 Thread Rick Root
Chris Tilley wrote: I've tried it but getting an error message: 12:52:15.015 - Expression Exception - in D:\Inetpub\cf\WorkingCapitalFund\FileReader.cfc : line 65 Variable RETURNSTRING is undefined. Any ideas why? Your cfc is referencing a variable that isn't defined? I don't

Re: Bulk data loading

2006-09-06 Thread Rick Root
Joseph Lamoree wrote: You'll probably get the best performance using the Oracle SQL*Plus tools, specifically SQL*Loader: http://www.orafaq.com/faq/sql_loader You are probably right - but for 1000 records, 145KB of data, and it only occurs once per year (I think that's what he said), it's

Re: Bulk data loading

2006-09-06 Thread Joseph Lamoree
On 6 Sep 2006, at 12:45, Rick Root wrote: You are probably right - but for 1000 records, 145KB of data, and it only occurs once per year (I think that's what he said), it's probably not worth the effort. True. I thought we were talking about a jazillion rows. I have a similar requirement for

RE: Bulk data loading

2006-09-06 Thread Ben Nadel
, September 06, 2006 3:26 PM To: CF-Talk Subject: Re: Bulk data loading I've tried it but getting an error message: 12:52:15.015 - Expression Exception - in D:\Inetpub\cf\WorkingCapitalFund\FileReader.cfc : line 65 Variable RETURNSTRING is undefined. Any ideas why? On 9/6/06

Re: Bulk data loading

2006-09-06 Thread Douglas Knudsen
yes. You can even do this 1) have user upload cvs file 2) use sqlloader called via cfexecute to load the data into the DB This will require installing the oracle client on the server and some patience :) DK On 9/6/06, Joseph Lamoree [EMAIL PROTECTED] wrote: On 6 Sep 2006, at 11:19, Chris

Re: Bulk data loading

2006-09-06 Thread Rick Root
Ben Nadel wrote: Sorry to come in late in the convo... If you can put the file in a public directory, I have found from some simple testing that CFHttp is faster than a buffered file reader... http://bennadel.com/blog/200-ColdFusion-CFHttp-To-Query-Much-Faster-Than-Jav

Re: Bulk data loading

2006-09-06 Thread Denny Valliant
Hey, that's pretty cool. Your method does work very well provided you're looking at well formatted, query like data (like a quality CSV) and the file is accessible via http. One way to get around poor quality CSV is similar to getting around poor quality WSDL(?) type stuff... grab the file,