Re: [sqlite] Slow inserts with UNIQUE

2011-10-31 Thread Fabian
2011/10/30 Black, Michael (IS) michael.bla...@ngc.com #1 What version? 3.7.8, using System.Data.Sqlite wrapper #2 How long to insert the 1M? 10 seconds #3 What's the average string size? 55 characters #5 How long to create the index? 10 seconds #6 How long to insert the

Re: [sqlite] Slow inserts with UNIQUE

2011-10-30 Thread Black, Michael (IS)
[sqlite-users-boun...@sqlite.org] on behalf of Fabian [fabianpi...@gmail.com] Sent: Saturday, October 29, 2011 12:11 PM To: General Discussion of SQLite Database Subject: EXT :Re: [sqlite] Slow inserts with UNIQUE 2011/10/29 Simon Slavin slav...@bigfraud.org When you insert the 10,000 strings

Re: [sqlite] Slow inserts with UNIQUE

2011-10-30 Thread Black, Michael (IS)
Discussion of SQLite Database Subject: EXT :Re: [sqlite] Slow inserts with UNIQUE 2011/10/29 Simon Slavin slav...@bigfraud.org When you insert the 10,000 strings are you doing it inside a transaction ? BEGIN TRANSACTION; INSERT ... INSERT ... INSERT ... COMMIT; Yes, I use transactions

[sqlite] Slow inserts with UNIQUE

2011-10-29 Thread Fabian
I have a table with one TEXT column. I insert 1 million rows of short strings, and then create an UNIQUE INDEX. The speed is very acceptable. Then I insert another 10.000 short strings, and the performance is very bad, it almosts take longer than inserting the initial million(!) rows to fill the

Re: [sqlite] Slow inserts with UNIQUE

2011-10-29 Thread Simon Slavin
On 29 Oct 2011, at 5:57pm, Fabian wrote: I have a table with one TEXT column. I insert 1 million rows of short strings, and then create an UNIQUE INDEX. The speed is very acceptable. Then I insert another 10.000 short strings, and the performance is very bad, it almosts take longer than

Re: [sqlite] Slow inserts with UNIQUE

2011-10-29 Thread Fabian
2011/10/29 Simon Slavin slav...@bigfraud.org When you insert the 10,000 strings are you doing it inside a transaction ? BEGIN TRANSACTION; INSERT ... INSERT ... INSERT ... COMMIT; Yes, I use transactions, prepared statements, cache_size, journal_mode and synchronous PRAGMA's, almost