Re: [sqlite] performance of one process using multiple independent sqlite databases

2012-09-22 Thread Keith Medcalf
Do you have multiple real CPU cores? Multiple fake cores (what intel calls hyperthreads)? When one thread in one process opens a database and runs it takes N seconds -- utilizing only one CPU of course. What is the CPU consumption while the process is running? When you use two processes,

Re: [sqlite] performance of one process using multiple independent sqlite databases

2012-09-22 Thread Bob Price
Yes, I have run this on SSD drives and on a ram disk where disk IO wasn't a limited factor. Bob From: Simon Slavin To: Bob Price ; General Discussion of SQLite Database Sent: Saturday,

[sqlite] performance of one process using multiple independent sqlite databases

2012-09-22 Thread Bob Price
I've been searching through the archive without much luck on this topic, so I'll ask my question.  If this has been answered somewhere else please point me to that. I have a single process that independently opens and uses multiple Sqlite databases, each with its own connection.  The data in

Re: [sqlite] dynamic bulk import

2012-09-22 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 22/09/12 13:41, Keith Medcalf wrote: > Take a look at the apsw (Another Python SQLite Wrapper) shell which has > an .autoimport command that may do what you want. Thanks for pointing out APSW (I'm the author). It is only necessary to use the APSW

Re: [sqlite] dynamic bulk import

2012-09-22 Thread Keith Medcalf
Take a look at the apsw (Another Python SQLite Wrapper) shell which has an .autoimport command that may do what you want. http://apidoc.apsw.googlecode.com/hg/shell.html#commands Code is here: http://code.google.com/p/apsw/ There are probably other tools and libraries that accomplish the

[sqlite] dynamic bulk import

2012-09-22 Thread Sébastien Roux
Hi is there way of doing a dynamic file import into sqlite without specifying the table fields. Just specifying the target (temporary?) table so columns or fileds are created dynamically. If this cannot be done with cmdline interface maybe using perl amodules (DBD, DBI)? Many thanks for any help

Re: [sqlite] Columns involved in a WHERE clause

2012-09-22 Thread Simon Slavin
On 21 Sep 2012, at 3:17pm, Marco Bambini wrote: > Can I parse the output of the EXPLAIN my_query statement in order to have an > indirect access to columns involved in the WHERE clause? Well, take a look at it. Do you think you can write a parser for it ? However, the

Re: [sqlite] Columns involved in a WHERE clause

2012-09-22 Thread Marco Bambini
Can I parse the output of the EXPLAIN my_query statement in order to have an indirect access to columns involved in the WHERE clause? -- Marco Bambini http://www.sqlabs.com http://twitter.com/sqlabs On Sep 21, 2012, at 4:10 PM, Richard Hipp wrote: > On Fri, Sep 21, 2012

Re: [sqlite] Is it possible to get the amalgation as individual files

2012-09-22 Thread Black, Michael (IS)
You may just want to split the amalgamation code...a wee bit easier...see the split utility in this dicussion. http://sqlite.1065341.n5.nabble.com/SQLite-Amalgamation-td11315.html Michael D. Black Senior Scientist Advanced Analytics Directorate Advanced GEOINT Solutions Operating Unit Northrop