I've got an in-memory database with a single table that I need to fill with ~500 million rows. There are no indexes and the table definitions is
create table data(id int, path int, month int, val1 double, val2 double, val3 double... val20 double) I'm running on linux with the OS page size configured to 4096 and ~380 GB of ram (much more than required for the table so I think I'm not swapping) and haven't altered the sqlite page size. I am using sqlite version 3.13.0 and these pragmas immediately after database creation. pragma temp_store = MEMORY pragma journal_mode = off With these settings I'm seeing nonlinear (in a bad way) times for the insert. Is that expected? I've fiddled about with various performance-related settings like described on https://blog.devart.com/increasing-sqlite-performance.html with varying results but haven't managed to arrive at fairly-linear insert behavior. It's a single-threaded insert on a prepared query with bound arguments in a tight loop. Is linear-ish insert time a reasonable goal for an in-memory database? ---------------------------------------------------------------------- This message, and any attachments, is for the intended recipient(s) only, may contain information that is privileged, confidential and/or proprietary and subject to important terms and conditions available at http://www.bankofamerica.com/emaildisclaimer. If you are not the intended recipient, please delete this message. _______________________________________________ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
