That is a good idea, but there will be 3 separate files from 150mb - 300mb
each that will need to be processed each day. Each record will have to be
updated/inserted/deleted from the db. So I'm trying for total automation
from the ftp retrieval to the complete db comparison.
:-(
It is becoming a vendetta!
je
-----Original Message-----
From: Dan Haley [mailto:[EMAIL PROTECTED]]
Sent: Friday, June 30, 2000 5:23 PM
To: '[EMAIL PROTECTED]'
Subject: RE: reading text files
Does it have to be fast? You could use VBA in Excel to read the file in
which would allow you to separate it to multiple sheets (without cutting up
the text file itself) for later import into Access or SQL. Or even VBA in
Access I suppose to read the file and do inserts. The VBA into Excel
wouldn't be too slow (we're counting in minutes though, not seconds or
milliseconds!), and then you could possibly automate the import into Excel
at the same time. Pretty much anything you can do manually in the Office
apps can be automated with VBA . . . sometimes they just need to be started
before heading for home . . . :)
Dan
-----Original Message-----
From: Jason Egan [mailto:[EMAIL PROTECTED]]
Sent: Friday, June 30, 2000 3:01 PM
To: [EMAIL PROTECTED]
Subject: RE: reading text files
yeah! --- that is exactly what we've had to do in the past, but we need to
automate and streamline...
I've tried the readline tag, but it still seems to bomb after a certain
amount of lines, not the same each time... unpredictable.
GRRRRRR.....
je
> -----Original Message-----
> From: Mark Warrick [mailto:[EMAIL PROTECTED]]
> Sent: Friday, June 30, 2000 2:20 PM
> To: [EMAIL PROTECTED]
> Subject: RE: reading text files
>
>
> I ran into the same problem in the past with a 50 MB text file
> that I need to import into SQL.
>
> I tried making it a spreadsheet and importing to Access first,
> but it cuts of at something like 65,000 lines. Same problem with
> importing directly into Access, it just bombs. Also, I tried
> importing directly into SQL, but SQL just froze up after 15
> minutes of processing.
>
> I ended up solving the problem but cutting up the text file into
> smaller pieces and doing a whole lot of imports. It was a
> tedious task, but it worked.
>
> If anyone knows the right way to do it and can direct us both to
> perhaps SQL help docs that describe it, I know we would both
> appreciate it.
>
> ---mark
>
> --------------------------------------------------------------
> Mark Warrick
> Phone: (714) 547-5386
> Efax.com Fax: (801) 730-7289
> Personal Email: [EMAIL PROTECTED]
> Personal URL: http://www.warrick.net
> Business Email: [EMAIL PROTECTED]
> Business URL: http://www.fusioneers.com
> ICQ: 346566
> --------------------------------------------------------------
>
>
> > -----Original Message-----
> > From: Jason Egan [mailto:[EMAIL PROTECTED]]
> > Sent: Friday, June 30, 2000 1:10 PM
> > To: Cf-Talk
> > Subject: reading text files
> >
> >
> > I have a rather large text file (145mb) that I need to read into a dB.
> >
> > The part I'm having trouble with is the READING of the file part. I am
> > using a line by line tag from the dev site to read in say 1000
> lines at a
> > time, but some times it bombs at line 500... then I'll run it
> again and it
> > works, then I run it again and it bombs at 532 or something
> like that... I
> > examine the lines and they are properly formatted, I've even
> taken out the
> > inserts and I still receive the errors when only reading the
> > files in... any
> > ideas why?
> >
> > Is it the file size?
> >
> > thanks,
> > je
> >
> > ------------------------------------------------------------------
> > ------------
> > Archives: http://www.eGroups.com/list/cf-talk
> > To Unsubscribe visit
> > http://www.houseoffusion.com/index.cfm?sidebar=lists&body=lists/cf
> > _talk or send a message to [EMAIL PROTECTED] with
> > 'unsubscribe' in the body.
>
> ------------------------------------------------------------------
> ------------
> Archives: http://www.eGroups.com/list/cf-talk
> To Unsubscribe visit http://www.houseoffusion.com/index.cfm?sidebar
>
----------------------------------------------------------------------------
--
Archives: http://www.eGroups.com/list/cf-talk
To Unsubscribe visit
http://www.houseoffusion.com/index.cfm?sidebar=lists&body=lists/cf_talk or
send a message to [EMAIL PROTECTED] with 'unsubscribe' in
the body.
----------------------------------------------------------------------------
--
Archives: http://www.eGroups.com/list/cf-talk
To Unsubscribe visit
http://www.houseoffusion.com/index.cfm?sidebar=lists&body=lists/cf_talk or
send a message to [EMAIL PROTECTED] with 'unsubscribe' in
the body.
------------------------------------------------------------------------------
Archives: http://www.eGroups.com/list/cf-talk
To Unsubscribe visit
http://www.houseoffusion.com/index.cfm?sidebar=lists&body=lists/cf_talk or send a
message to [EMAIL PROTECTED] with 'unsubscribe' in the body.
