Re: Repeat loops in mysql, large data issue, suggestions wanted

2004-05-21 Thread beacker
Scott Haneda writes: >My trouble is that the data file could be 100,000 lines in length, I have a >few options: Scott, I have a 30 million record dataset that I load into MySQL every couple of months. To do this propitiously I use the 'LOAD DATA INFILE' syntax. >From your description it shou

Re: Repeat loops in mysql, large data issue, suggestions wanted

2004-05-20 Thread Scott Haneda
on 05/20/2004 10:18 PM, David Griffiths at [EMAIL PROTECTED] wrote: >> >> I can use any I like, I wont have not even built the DB yet, so I am open to >> any suggestions. >> >> I don't see how I can do it all in one transaction, what does that mean? >> >> >> > What that means is you do 100,0

Re: Repeat loops in mysql, large data issue, suggestions wanted

2004-05-20 Thread David Griffiths
You didn't mention the table-type (storage-engine) you were planning on using, but if you use InnoDB, and do it all in one transaction (ie turn off auto-commit and commit just once at the endi), then any failure during the mass-insert will cause a rollback, so you don't have to worry about the int

Re: Repeat loops in mysql, large data issue, suggestions wanted

2004-05-20 Thread Scott Haneda
on 05/20/2004 09:36 PM, David Griffiths at [EMAIL PROTECTED] wrote: > You didn't mention the table-type (storage-engine) you were planning on > using, but if you use InnoDB, and do it all in one transaction (ie turn > off auto-commit and commit just once at the endi), then any failure > during the

Re: Repeat loops in mysql, large data issue, suggestions wanted

2004-05-20 Thread David Griffiths
Assuming you insert 100,000 rows, you also have to consider that any indexes on the table will need to be re-analyzed to fix the statics. Also, the inserts will be slower due to any indexes. You didn't mention the table-type (storage-engine) you were planning on using, but if you use InnoDB, an

Repeat loops in mysql, large data issue, suggestions wanted

2004-05-20 Thread Scott Haneda
Faced with some larger than usual for me data requirements, I thought I would ask some others what they think about my logic. MySql 4 In short, I will have a file upload on a web server that will digest a file, I will be able to dictate the format of this file. There may be a few formats, the mai

Re: conditionnal loops in mysql

2002-04-11 Thread Jeremy Zawodny
On Tue, Apr 09, 2002 at 10:01:25AM +0200, Van Overbeke, Tom wrote: > > now, i'd like to change each record in table1 where a field contains > a +ADSM entry, lookup the corresponding records in table 2, and, in > this case for example, add 3 records to table1 where the +ADSM field > is replaced by

conditionnal loops in mysql

2002-04-09 Thread Van Overbeke, Tom
Hi, I've got 2 tables in mysql, table 1 which contains records with fields like +ADSM in table 2, I got records like: +ADSM anr2343E +ADSM anr4523E +ADSM anr7823E now, i'd like to change each record in table1 where a field contains a +ADSM entry, lookup the co

Loops in Mysql

2002-03-06 Thread Victoria Reznichenko
Amit, Wednesday, March 06, 2002, 6:38:30 AM, you wrote: AL> What I want to do is import data from some other AL> database to Mysql. For this the requirement is that, AL> each record before being added to Mysql database, AL> should pass through a loop say 5 times. This I want to AL> do using only

Loops in Mysql

2002-03-05 Thread Amit Lonkar
Hi What I want to do is import data from some other database to Mysql. For this the requirement is that, each record before being added to Mysql database, should pass through a loop say 5 times. This I want to do using only SQL. I do not want ot use Java or any other language. Any idea as to how