Re: SCALING INSERT

2010-01-26 Thread Shawn Green
Krishna Chandra Prajapati wrote: Hi shawn, As the data grows to 20 millions the insert rate will become very slow. In such case i am getting 2000 insert/seconds only. Therefore my objective is not achieved. I cannot slow up the insert rate of 10,000/second. I am getting data (inserted by

Re: SCALING INSERT

2010-01-23 Thread Krishna Chandra Prajapati
Hi shawn, As the data grows to 20 millions the insert rate will become very slow. In such case i am getting 2000 insert/seconds only. Therefore my objective is not achieved. I cannot slow up the insert rate of 10,000/second. I am getting data (inserted by users at this rate) Is there any other

Re: SCALING INSERT

2010-01-23 Thread fsb
non-linearity in the insert rate means you have indexes on some columns. depending on your situation, mysql can be more efficient if drop those indexes, do bulk inserts, and then add the indexes again. On 1/23/10 5:02 AM, Krishna Chandra Prajapati prajapat...@gmail.com wrote: Hi shawn, As

Re: SCALING INSERT

2010-01-23 Thread Alexander Kolesen
If you only need very fast INSERTs, you might try to use ARCHIVE storage engine ( http://dev.mysql.com/tech-resources/articles/storage-engine.html ). It was developed for handling INSERTs very fast. Many peoples use it, for example, for storing logs. Hi list, I want to insert 1 records/sec

Re: SCALING INSERT

2010-01-22 Thread walter harms
Krishna Chandra Prajapati schrieb: Hi list, I want to insert 1 records/sec into table. There can be n number of tables with unique data in each. What are the possible ways to do ? i prefer mysqlimport. just sort your output into a file that is named like the table you wish to

SCALING INSERT

2010-01-21 Thread Krishna Chandra Prajapati
Hi list, I want to insert 1 records/sec into table. There can be n number of tables with unique data in each. What are the possible ways to do ? Thanks, Krishna

Re: SCALING INSERT

2010-01-21 Thread Shawn Green
Krishna Chandra Prajapati wrote: Hi list, I want to insert 1 records/sec into table. There can be n number of tables with unique data in each. What are the possible ways to do ? Thanks, Krishna The manual is your friend. It doesn't hurt to consult it. INSERT ...