Re: [sqlite] long running INSERT (up to now ~ 11 hours and still working)

2011-01-12 Thread Oliver Peters
Dan Kennedy danielk1...@... writes: [...] Most INSERTS are done into the table Verteilerdaten (10,000,000). I think the time depends heavily on the activated FOREIGN KEYs - is my assumption correct and is this a behaviour I only can avoid by not switching this PRAGMA on? [...]

Re: [sqlite] long running INSERT (up to now ~ 11 hours and still working)

2011-01-12 Thread Oliver Peters
Hello, [...] deleting PRAGMA foreign_keys = ON; led to a miracle: everything completed after 30 minutes. Because of the enormous difference (~ 24h without finish compared to 30 minutes) I can imagine that there are ways to otimize the speed with the use of FKs - but that seems to be a

[sqlite] long running INSERT (up to now ~ 11 hours and still working)

2011-01-11 Thread Oliver Peters
Hello, I'm on WinXP and using sqlite 3.7.4 with the CLI. I try to insert ~ 10,100,000 records into a schema with different tables (http://pastebin.com/cbsPHNEj). The db file has already 1.9 GB when I start the INSERTs via sqlite3 -bail extra.db3 inserts.sql The statements in inserts.sql look

Re: [sqlite] long running INSERT (up to now ~ 11 hours and still working)

2011-01-11 Thread Simon Slavin
On 11 Jan 2011, at 8:00am, Oliver Peters wrote: I'm on WinXP and using sqlite 3.7.4 with the CLI. I try to insert ~ 10,100,000 records into a schema with different tables It that takes 11 hours, that means you're taking about 4ms per INSERT. I don't know if this is unusually high. You

Re: [sqlite] long running INSERT (up to now ~ 11 hours and still working)

2011-01-11 Thread Oliver Peters
Hello, Simon Slavin slav...@... writes: [...] It that takes 11 hours, that means you're taking about 4ms per INSERT. I don't know if this is unusually high. You might like to try 'PRAGMA synchronous = OFF' http://www.sqlite.org/pragma.html#pragma_synchronous sqlite3 -bail extra.db3

Re: [sqlite] long running INSERT (up to now ~ 11 hours and still working)

2011-01-11 Thread Dan Kennedy
On 01/11/2011 03:00 PM, Oliver Peters wrote: Hello, I'm on WinXP and using sqlite 3.7.4 with the CLI. I try to insert ~ 10,100,000 records into a schema with different tables (http://pastebin.com/cbsPHNEj). The db file has already 1.9 GB when I start the INSERTs via sqlite3 -bail