Re: Mass insert on InnoDB

2008-01-29 Thread David Schneider-Joseph
On Jan 29, 2008, at 6:21 PM, BJ Swope wrote: drop the indexes for the conversion then rebuild the indexes after the tables are converted. As noted in my original email, I tried that, but Jan's suggestion re: InnoDB tuning fixed it. Thanks for the advice, everyone! David -- MySQL General

Re: Mass insert on InnoDB

2008-01-29 Thread David Schneider-Joseph
On Jan 29, 2008, at 7:04 PM, Jan Kirchhoff wrote: play around with innodb_log_buffer_size, innodb_log_file_size and try to set innodb_flush_log_at_trx_commit=0. Do you don't have a BBU on your raid-controller? let me know if that changes anything. That did it! I upped the log_buffer_size

Re: Mass insert on InnoDB

2008-01-29 Thread BJ Swope
drop the indexes for the conversion then rebuild the indexes after the tables are converted. On Jan 29, 2008 4:08 PM, David Schneider-Joseph <[EMAIL PROTECTED]> wrote: > Hi all, > > I am attempting to convert a very large table (~23 million rows) from > MyISAM to InnoDB. If I do it in chunks of

Re: Mass insert on InnoDB

2008-01-29 Thread Jan Kirchhoff
David Schneider-Joseph schrieb: On Jan 29, 2008, at 6:09 PM, Jan Kirchhoff wrote: what hardware are you running on and you much memory do you have? what version of mysql?| | How did you set innodb_buffer_pool_size? Hardware: Dual AMD Opteron 246 2.0 GHz 4 GB DDR RAM (no swap being used) Dual

Re: Mass insert on InnoDB

2008-01-29 Thread David Schneider-Joseph
On Jan 29, 2008, at 6:09 PM, Jan Kirchhoff wrote: what hardware are you running on and you much memory do you have? what version of mysql?| | How did you set innodb_buffer_pool_size? Hardware: Dual AMD Opteron 246 2.0 GHz 4 GB DDR RAM (no swap being used) Dual 146 GB SCSI drives with a RAID

Re: Mass insert on InnoDB

2008-01-29 Thread David Schneider-Joseph
On Jan 29, 2008, at 4:37 PM, Baron Schwartz wrote: It's because your index is bigger than your memory (or at least bigger than your InnoDB buffer pool). InnoDB can't build indexes by sorting rows, so building the indexes gets slow. Hmm, this would be an interesting theory for the main table i

Re: Mass insert on InnoDB

2008-01-29 Thread Jan Kirchhoff
David Schneider-Joseph schrieb: Hi all, I am attempting to convert a very large table (~23 million rows) from MyISAM to InnoDB. If I do it in chunks of one million at a time, the first million are very fast (approx. 3 minutes or so), and then it gets progressively worse, until by the time I

Re: Mass insert on InnoDB

2008-01-29 Thread Baron Schwartz
Hi, On Jan 29, 2008 4:08 PM, David Schneider-Joseph <[EMAIL PROTECTED]> wrote: > Hi all, > > I am attempting to convert a very large table (~23 million rows) from > MyISAM to InnoDB. If I do it in chunks of one million at a time, the > first million are very fast (approx. 3 minutes or so), and th

Mass insert on InnoDB

2008-01-29 Thread David Schneider-Joseph
Hi all, I am attempting to convert a very large table (~23 million rows) from MyISAM to InnoDB. If I do it in chunks of one million at a time, the first million are very fast (approx. 3 minutes or so), and then it gets progressively worse, until by the time I get even to the fourth chunk