Re: [sqlite] Uncached performance

2015-01-08 Thread Teg
Hello Donald, DG> 1) Might there be further performance gains by placing the blobs in a DG> separate table? DG> E.g. DG> CREATE TABLE myBlobs ( DG> idINTEGER PRIMARY KEY REFERENCES global (id), DG> value BLOB DG> ); DG> Then (if you haven't rebuilt a new

Re: [sqlite] Uncached performance

2015-01-08 Thread Donald Griggs
Hi, Maksim, Others with more knowledge than I have given great advice regarding placing your blob as the *last* table column, and about looking at cache size and page size. I wondered about three things: 1) Might there be further performance gains by placing the blobs in a separate table?

Re: [sqlite] Uncached performance

2015-01-08 Thread David King
> SS> Is there a difference between a key being present in your database with > NULL value, and the key not being present ? > Surely there is. But, actually, those 1 queries are made only to keys > with a non-NULL value (usually less than 1 Kb, and maybe 20% are about 16 > kb). *Probably* not

Re: [sqlite] Uncached performance

2015-01-08 Thread Kees Nuyt
On Thu, 8 Jan 2015 15:04:28 +0500, ?? ??? wrote: > CREATE TABLE global ( > [key] VARCHAR (1024), > value BLOB, > level INTEGER NOT NULL, > original_name VARCHAR (1024), > id INTEGER PRIMARY KEY AUTOINCREMENT, > parent_id REFERENCES global (id) > ); The order of

Re: [sqlite] Uncached performance

2015-01-08 Thread Максим Гумеров
Thanks for your responces! SS> This suggests that you are filling up a cache, especially if your BLOBs are large. In terms of overall time, 1 queries in 2 seconds is 5000 queries a second. If you are using a rotating hard disk then this is not unexpected, given that your disk probably

Re: [sqlite] Uncached performance

2015-01-08 Thread Keith Medcalf
>My database weights a little less than 2 Gbs and contains 130'000 keys. >When I put it on HDD and try to make 1 queries (extracting values for >1 different keys) with some additional processing of extracted >values, it takes about 4 seconds on my PC on any run except the first, >with

Re: [sqlite] Uncached performance

2015-01-08 Thread Simon Slavin
On 8 Jan 2015, at 10:04am, Максим Гумеров wrote: > When I put it on HDD and try to make 1 queries (extracting values for > 1 different keys) with some additional processing of extracted values, > it takes about 4 seconds on my PC on any run except the first, with

[sqlite] Uncached performance

2015-01-08 Thread Максим Гумеров
Hello! Imagine I am trying to introduce a local key-value SQLite database for caching some data retrieved from a remote server. Key is a character string, value is a BLOB (and for 50% keys is just NULL). I will specify the details later. My database weights a little less than 2 Gbs and contains