I wrote a CFC that helps me automating similar tasks:
http://www.olimpo.ch/tmt/cfc/tmt_csv.zip
Check it out andsee if it may fit your needs
Massimo Foti
DW tools: http://www.massimocorner.com
CF tools: http://www.olimpo.ch/tmt/
If you're using Oracle and can run sqlldr.exe wouldnt that be your
best practice? For an Oracle system?
On Wed, 1 Dec 2004 11:11:33 +0100, Massimo Foti [EMAIL PROTECTED] wrote:
I wrote a CFC that helps me automating similar tasks:
http://www.olimpo.ch/tmt/cfc/tmt_csv.zip
Check it out
On Tue, 30 Nov 2004 11:12:54 -0800, Bryan Stevenson
[EMAIL PROTECTED] wrote:
Yep...but you can fire DTS on the fly ;-)
Absolutely...several ways as a matter of fact.
--
Scott Stroz
Boyzoid.com
___
Some days you are the dog,
Some days you are the tree.
As best I can tell, yes. I use SQLLDR triggered by a nightly windows
scheduler for one project and works out great. Though DTS would be so
much nicer to use and could even import into a Oracle DB just doubtful
one would have access to DTS if in an environment that uses Oracle. I
have yet to try
I use sqlldr from a cfexecute call in CF. It's remarkably fast. I load
some 25,000 rows (some 300 columns in length) from an uploaded txt
document. It only takes a few minutes to do so.
On Wed, 1 Dec 2004 09:58:09 -0600, Aaron Rouse [EMAIL PROTECTED] wrote:
As best I can tell, yes. I use
Yeap, it is fast the three files I import nightly each are at least
50k rows and some columns upwards of 2000 characters. They only take
a few minutes to go in and would be quicker if I disabled the indexes,
just never gone back to that project to change things since everyone
is plenty happy with
Client is looking for an application to import a delimited list of names
and email addresses directly into a database for further manipulation.
While I can think of a number of ways to pull this off, what's the
opinion on the most efficient way to doing it?
Thanks,
--
Les Mizzell
Depends on the database and the source ;-)
SQL Server...use DTS (data transformation service) to import the list (CSV
file...Excel file...other DB)
Any tab or comma delimited file should be super easy to parse and insert
into the DB...client could upload file and that would fire off the
You could:
Use a DTS package for the import.
Treat the file like a cf datasource using the txt driver.
Read the file using cf_file and step through each record tucking it into the db.
I'd want a little more detail on what database, how long the list is and how
often this happens before deciding.
SQL Server...use DTS (data transformation service) to import the list (CSV
file...Excel file...other DB)
This will have to be done from an administration form from a web page.
The client isn't going to have access to the SQL Admin, nor do we want
him too!!
--
Les Mizzell
.
John Burns
-Original Message-
From: Les Mizzell [mailto:[EMAIL PROTECTED]
Sent: Tuesday, November 30, 2004 1:55 PM
To: CF-Talk
Subject: Best Practice: Import Delimited List to Database
Client is looking for an application to import a delimited list of names
and email addresses directly
What is the source of this list? If it's a file, what is the size. Raymond
wrote a nice UDF wrapper for a java call that imports and loops over a file
that works better than CFFILE/CFLOOP. I've used it (modified) to import a
few hundred thousand line file into a DB.
Once you have the data and
At 02:01 PM 11/30/2004, Bryan Stevenson wrote:
Depends on the database and the source ;-)
And how often it needs to be done. Once? Once a day?
And who is going to do it. SQL Programmer? Secretary?
No one will be able to advise you on efficiency until
you specify who you're trying to make it
Cold fusion can execute DTS packages from the server. A cfm page can gather the
data, set up the database, then trigger the DTS package to run the import
without the user even being aware of what is happening.
Jerry
Jerry Johnson
Web Developer
Dolan Media Company
[EMAIL PROTECTED] 11/30/04
Mizzell [EMAIL PROTECTED]
To: CF-Talk [EMAIL PROTECTED]
Sent: Tuesday, November 30, 2004 11:04 AM
Subject: Re: Best Practice: Import Delimited List to Database
SQL Server...use DTS (data transformation service) to import the list
(CSV
file...Excel file...other DB)
This will have to be done from
What was the name of that UDF? I would not mind looking into it since
I have the need to import some excel data via a web form into an
Oracle database. They would be saving their spreadsheets as CSV files
then uploading them via a web form.
--
Aaron Rouse
http://www.happyhacker.com/
On Tue,
FileRead
http://cflib.org/udf.cfm?ID=417
What was the name of that UDF? I would not mind looking into it since
I have the need to import some excel data via a web form into an
Oracle database. They would be saving their spreadsheets as CSV files
then uploading them via a web form.
--
a status
bar that updates via javascript when a certain percentage of the records
are done.
I hope that makes sense and helps.
John Burns
-Original Message-
From: Les Mizzell [mailto:[EMAIL PROTECTED]
Sent: Tuesday, November 30, 2004 2:04 PM
To: CF-Talk
Subject: Re: Best Practice: Import
If you're running SQL server check out BULK INSERT.
Adam
On Tue, 30 Nov 2004 13:12:57 -0600, Aaron Rouse [EMAIL PROTECTED] wrote:
What was the name of that UDF? I would not mind looking into it since
I have the need to import some excel data via a web form into an
Oracle database. They
I am using Oracle, was stated in my quoted msg you included. I could
use SQLLDR, this import need is down low on the todo list so I have
just randomly been looking into different avenues.
--
Aaron Rouse
http://www.happyhacker.com/
On Tue, 30 Nov 2004 14:19:04 -0500, Adam Haskell [EMAIL
Sorry quoted the wrong person was directed toward Les. Your post was
the last post and I hit reply, case of me being lazy :)
Adam
On Tue, 30 Nov 2004 13:31:40 -0600, Aaron Rouse [EMAIL PROTECTED] wrote:
I am using Oracle, was stated in my quoted msg you included. I could
use SQLLDR, this
cfx_text2query and cfx_excel2query are two good _free_ tags for data import :)
http://www.emerle.net/programming/
On Tue, 30 Nov 2004 13:12:57 -0600, Aaron Rouse [EMAIL PROTECTED] wrote:
What was the name of that UDF? I would not mind looking into it since
I have the need to import some
Only problem with a CFX tag is it would mean involving the data center
admins here and they do not like having to do anything out of the
norm. I am guessing Raymond's UDF tag would work on a CFMX box, which
this particular site should be on whenever blackstone is released.
Not even sure if I
I'd want a little more detail on what database, how long the list is and how
often this happens before deciding.
Database: SQL Server
How often: As needed. Could be once an hour or once a week, who knows.
Client certainly doesn't!
I've built a pretty extensive administration system for them
-Original Message-
From: Les Mizzell [mailto:[EMAIL PROTECTED]
Sent: Tuesday, November 30, 2004 3:32 PM
To: CF-Talk
Subject: Re: Best Practice: Import Delimited List to Database
I'd want a little more detail on what database, how long the list is
and how often this happens before deciding.
Database
Ryan's cfx_text2query (he posted the link a few messages back) turned
a 10k-line-per operation run once every 15 minutes from executing in
several minutes to several seconds. I forget the exact factor but it
was dramatic. The original code was some cffile+cfloop+insert stuff.
--
--Matt
26 matches
Mail list logo
