Writes are slow if you do one insert per transaction.
http://search.cpan.org/perldoc?DBD::SQLite#Performance
Owen wrote:
I have a sqlite (version 3.6.13) database with 300000+ rows
1500 of these rows have faulty data.
So I read the main database row by row, tested the validity of one
column, and inserted the good rows into a new database.
This process took 27 minutes on a fairly recent desktop computer.
( about 10000 rows a minute or 170 a second )
I thought the whole process would take a few seconds, so I wonder if 27
minutes is a reasonable time for this database creation.
As the database was being created, I noticed a journal file was in use
though I haven't worked out what that did, yet.
TIA
Owen
