Re: [sqlite] Big performance problem with inserting lots of data

2009-08-31 Thread Terence Lorenzo
adding "begin transaction" before inserting data then "commit transaction" will surely boost the inserts Kalle Last wrote: > > Hello, > > I'm having a big performance problem while trying to use sqlite as a > data output for my application. The application writes out a bunch of > packets rel

Re: [sqlite] Big performance problem with inserting lots of data

2009-08-31 Thread Ken
> Only problem is > > there seems to be 1-2s freeze on the moment I create a > new file. > If you are talking about creating a new database periodically with the same tables: try creating a "template database" and copy that to the new working version.

Re: [sqlite] Big performance problem with inserting lots of data

2009-08-31 Thread D. Richard Hipp
On Aug 31, 2009, at 11:07 AM, Kalle Last wrote: > 2009/8/31 D. Richard Hipp : >> >> On Aug 31, 2009, at 10:28 AM, Kalle Last wrote: >> >>> Hello, >>> >>> I'm having a big performance problem while trying to use sqlite as a >>> data output for my application. >> >> Before going further, have you s

Re: [sqlite] Big performance problem with inserting lots of data

2009-08-31 Thread Kalle Last
2009/8/31 D. Richard Hipp : > > On Aug 31, 2009, at 10:28 AM, Kalle Last wrote: > >> Hello, >> >> I'm having a big performance problem while trying to use sqlite as a >> data output for my application. > > Before going further, have you seen http://www.sqlite.org/faq.html#q19 ? > > Weird, I tried

Re: [sqlite] Big performance problem with inserting lots of data

2009-08-31 Thread D. Richard Hipp
On Aug 31, 2009, at 10:28 AM, Kalle Last wrote: > Hello, > > I'm having a big performance problem while trying to use sqlite as a > data output for my application. Before going further, have you seen http://www.sqlite.org/faq.html#q19 ? D. Richard Hipp d...@hwaci.com ___

[sqlite] Big performance problem with inserting lots of data

2009-08-31 Thread Kalle Last
Hello, I'm having a big performance problem while trying to use sqlite as a data output for my application. The application writes out a bunch of packets relatively fast. There are about 10 different types of them with all but one sizing under 100 bytes. Those small ones I write out roughly once p