On Aug 19, 2014, at 11:11 PM, joe.fis...@tanguaylab.com 
<joe.fis...@tanguaylab.com> wrote:

> Is there something better I can do to improve this process?


PRAGMA journal_mode  = off;

http://www.sqlite.org/pragma.html#pragma_journal_mode


> Perhaps one transaction? Perhaps turn something off? It took about 1.5 hours 
> to run. I use the temp table because every CSV files has a header with the 
> column names. I have to drop the table each time because of the header issue.

Preprocess your files by dropping the first line beforehand, e.g.: 

sed -i ā€˜1dā€™

That will save half of your time already.

_______________________________________________
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Reply via email to