Re: [sqlite] .import Optimization

2006-03-05 Thread Joe Wilson
Kevin, I'm sure the SQLite mailing list would very much like to hear how long it takes to insert 400 million rows with (and without) an index using a PRAGMA cache_size=3000 on a 48G RAM machine. And how big the final database turns out to be. You might also want to play with a larger page_s

Re: [sqlite] .import Optimization

2006-03-05 Thread drh
"Kevin Bartz" <[EMAIL PROTECTED]> wrote: > Hi SQLite, > > > > Thanks for building such a wonderful product. I've used BerkeleyDBs in > the past and have been pleased to have SQLite's SQL interface. That > said, I have some questions about optimizing .import. > > > > I'd like to load a tab-d

[sqlite] .import Optimization

2006-03-05 Thread Kevin Bartz
Hi SQLite, Thanks for building such a wonderful product. I've used BerkeleyDBs in the past and have been pleased to have SQLite's SQL interface. That said, I have some questions about optimizing .import. I'd like to load a tab-delimited file that's about 40G and has 400M rows, and I'd like