safely load live db ?

2002-09-06 Thread Monte Ohrt
Hi, I have hundreds of mysql databases on a server, mostly filled with newspaper articles for web sites. For one particular database, I have about 10,000 archived articles I want to load in. I want to do this without affecting the performance of the live site (or any other sites using this

Re: safely load live db ?

2002-09-06 Thread Gerald Clark
You need to throttle back the inserts. You are doing 5-10 inserts per second, but that is fully loading the server. Do 1 or 2 inserts, and sleep a second. Monte Ohrt wrote: Hi, I have hundreds of mysql databases on a server, mostly filled with newspaper articles for web sites. For one

Re: safely load live db ?

2002-09-06 Thread Monte Ohrt
Thanks for the quick reply Gerald. What specifically is being loaded? The system load certainly isn't the problem. Is it a buffer that fills, or a lock queue, or something else? Although the inserts are done in rapid succession, there is only one connection at a time so it shouldn't be a # of

Re: safely load live db ?

2002-09-06 Thread Gerald Clark
With many indicies, inserts can be slow, and since you are queueing them up as fast as possible, no other queries have a chance to get in. Monte Ohrt wrote: Thanks for the quick reply Gerald. What specifically is being loaded? The system load certainly isn't the problem. Is it a buffer

Re: safely load live db ?

2002-09-06 Thread Monte Ohrt
I see. Is there a way to avoid the query queue and wait for a commit on each insert, or must I guess at it and insert a few, sleep, repeat ? TIA Monte Gerald Clark wrote: With many indicies, inserts can be slow, and since you are queueing them up as fast as possible, no other queries have a