Re: Re: Mysql Innodb performance slow

2002-10-27 Thread Paul DuBois
sql,query At 15:50 -0600 10/25/02, Jeff Mathis wrote: Paul DuBois wrote: >(2) drop all indexes on your table(s). rebuild them after loading (this >alone can give orders of magnitude improvement) For ISAM or MyISAM, that works. It has no effect for InnoDB. Do you actually observe a rep

Re: Mysql Innodb performance slow

2002-10-27 Thread Dan Nelson
In the last episode (Oct 25), Jeff Mathis said: > I'll agree to this somewhat: > > (1) always bind your variables. whatever code you are using to do your > inserts, the fewer prepared statements you can make the better. > > for example: > insert into TableName (col1, col2, col2, col4) values (?,?

Re: Mysql Innodb performance slow

2002-10-26 Thread Mark Matthews
David Lloyd wrote: Mark, Note that mysql does not support bind variables. If you think you're>using them, whatever API you are using is filling them in before>sending the statement to mysql. Bind variables do solve quoting>problems, though, so if you use them, know why you're using them :)>

Re: Mysql Innodb performance slow

2002-10-26 Thread Paul DuBois
At 15:46 -0600 10/25/02, Jeff Mathis wrote: forgive me. i was initially using the perl DBI methods to load. I am not intimately familiar with the inner workings of DBI, but obviously it must be doing something if you say mysql does not support binding variables (i am using 4.0.4). This is signifi

Re: Mysql Innodb performance slow

2002-10-26 Thread David Lloyd
Mark, > >>Note that mysql does not support bind variables. If you think > >you're>using them, whatever API you are using is filling them in > >before>sending the statement to mysql. Bind variables do solve > >quoting>problems, though, so if you use them, know why you're using > >them :)> Rumou

Re: Mysql Innodb performance slow

2002-10-25 Thread Mark Matthews
Jeff Mathis wrote: forgive me. i was initially using the perl DBI methods to load. I am not intimately familiar with the inner workings of DBI, but obviously it must be doing something if you say mysql does not support binding variables (i am using 4.0.4). This is significantly faster than creati

Re: Mysql Innodb performance slow

2002-10-25 Thread Jeff Mathis
forgive me. i was initially using the perl DBI methods to load. I am not intimately familiar with the inner workings of DBI, but obviously it must be doing something if you say mysql does not support binding variables (i am using 4.0.4). This is significantly faster than creating a new prepared st

Re: Mysql Innodb performance slow

2002-10-25 Thread Mark Matthews
Jeroen Geusebroek wrote: [snip] You where right, what i did use indivudual inserts. Now I have it segmented in 1000 rows in one query which massively speeds up the whole inserting progress. 160K records now takes about 20 seconds instead of the 100 records ;) I'm really impressed by this massive s

Re: Mysql Innodb performance slow

2002-10-25 Thread Jeff Mathis
I'll agree to this somewhat: (1) always bind your variables. whatever code you are using to do your inserts, the fewer prepared statements you can make the better. for example: insert into TableName (col1, col2, col2, col4) values (?,?,?,?) then, once you have a prepared statment, do a loop and

RE: Mysql Innodb performance slow

2002-10-25 Thread Jeroen Geusebroek
Hi, >What method are you using for inserting the data? >Individual INSERTs can be very slow: > INSERT INTO foo (x, y, z) VALUES (1, 2, 3); > INSERT INTO foo (x, y, z) VALUES (4, 5, 6); > ... >Batch INSERTs can be massively faster: > INSERT INTO foo (x, y, z) VALUES (1, 2,

Re: Mysql Innodb performance slow

2002-10-25 Thread Richard Clarke
Jeroen, Two things are likely to make this umpteen times faster. a) Commit the insert transaction every.. say 1000 records? b) use mysql's extended insert statement, insert into mytable values (row1_field1,row1_field2),(row2_field1,row2_field2),(?,?),(?,?) etc etc Ric. - Original M