Thanks you for all of the ideas. Here are answers to the various questions:
1) Currently, I am committing after every 10,000 inserts. Initially, I was running all of the inserts of a set (25,000+ records) in one transaction. I found that I was able to improve performance slightly by committing after every 10,000 records. Either way, the performance is still too poor. 2) I am going directly to the dll (not using ODBC). 3) I am already using PRAGMA default_synchronous=OFF Thank you all for the help. Regards, Soham Here are the directions to my test application again. It should be really easy to run. I would greatly appreciate it, if someone would take a look at it. 1) download the test zip file from the following FTP location (14MB): ftp://ftp.fileburst.com/ USER: sqlite PSWD: sqlhelp 2) unzip it 3) run register.bat (this just registers a required COM object) 4) open DataLoaderTest\DataLoaderTest.sln 5) build 6) run (you can do this directly from the debugger) 7) click on "Load Data" -----Original Message----- From: andy [mailto:[EMAIL PROTECTED] Sent: Thursday, June 24, 2004 2:38 PM To: [EMAIL PROTECTED] Subject: Re: [sqlite] Performance Issue with SQLite Inserts Soham Mehta wrote: > Hello, > > We recently switched to SQLite in our application and have not been able to > get the performance that partially motivated the switch. Our application > downloads TV guide data from the internet and loads it into a local > database. > <SNIP> > > Obviously, this does not match up with the performance tests that appear on > the website. Is there something that we are doing wrong? Any help or > guidance that you can provide would be greatly appreciated. > > > Regards, First a few questions... Are you running the entire import in one transaction? Are you using ODBC or right to the DLL? Have you tried using PRAGMA synchronous = OFF? see: http://sqlite.org/lang.html#pragma_default_synchronous (* where it says its 50% faster this way, and warns about corrupting the db *) -Andy --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
