Thanks for all the responses. In the end I went with the CREATE TEMP TABLE ... option which has worked very well and seems to have negligible overhead (on the order of 0.006s to create ~40 temporary tables and similarly quick to drop them).
-----Original Message----- From: sqlite-users-bounces at mailinglists.sqlite.org [mailto:sqlite-users-boun...@mailinglists.sqlite.org] On Behalf Of Petite Abeille Sent: Wednesday, April 15, 2015 6:24 PM To: General Discussion of SQLite Database Subject: Re: [sqlite] Best way to temporarily store data before processing > On Apr 14, 2015, at 11:40 AM, Jonathan Moules <J.Moules at hrwallingford.com> > wrote: > > Options that have come to mind (probably missed a lot): I personally use temp tables, e.g. 'create temporary table if not exists foo?, coupled with 'pragma temp_store = memory?, and drop/create them as necessary, e.g. 'drop table if exists?. There is a set of ETL (Extract, Transform and Load) operations to massage the data just so to their final resting place. Will not qualify this as ?best?, but it?s very workable and without much of a headache. As always, your milage may vary. _______________________________________________ sqlite-users mailing list sqlite-users at mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users This message has been scanned for viruses by MailControl - www.mailcontrol.com Click https://www.mailcontrol.com/sr/qYyWV6h9JtHGX2PQPOmvUj!GOBh06pKK75cHS8CBt56rbyGA4ThgbelonLeAq9lKW2cQtZ6+iOpzr!jqbv!p6A== to report this email as spam. ________________________________ HR Wallingford and its subsidiaries uses faxes and emails for confidential and legally privileged business communications. They do not of themselves create legal commitments. Disclosure to parties other than addressees requires our specific consent. We are not liable for unauthorised disclosures nor reliance upon them. If you have received this message in error please advise us immediately and destroy all copies of it. HR Wallingford Limited Howbery Park, Wallingford, Oxfordshire, OX10 8BA, United Kingdom Registered in England No. 02562099 ________________________________