Re: [sqlite] Direct use of SQLite btree functions / performance

2006-04-20 Thread Matt Sergeant
On 20-Apr-06, at 9:10 AM, Jay Sprenkle wrote: Just out of curiosity why is this data in the database? I've seen very few applications where the blob is indexed or operated upon by the database and it's always a pain to deal with it. We always just left binary data in the file system and

Re: [sqlite] Direct use of SQLite btree functions / performance

2006-04-20 Thread Jay Sprenkle
On 4/20/06, Dennis Jenkins <[EMAIL PROTECTED]> wrote: > Jay Sprenkle wrote: > > Just out of curiosity why is this data in the database? > > I've seen very few applications where the blob is indexed or operated upon > > by the database and it's always a pain to deal with it. We always just > > left

Re: [sqlite] Direct use of SQLite btree functions / performance

2006-04-20 Thread Dennis Jenkins
Jay Sprenkle wrote: > Just out of curiosity why is this data in the database? > I've seen very few applications where the blob is indexed or operated upon > by the database and it's always a pain to deal with it. We always just > left binary data in the file system and stored references to it in

Re: [sqlite] Direct use of SQLite btree functions / performance

2006-04-20 Thread Jay Sprenkle
> > > > sqlite3BtreeData() actually reads a prefix of the data. > > Because of the way large blobs are stored (as a linked list > > of disk pages) you have to start reading at the beginning > > and read everything up to the point of interest. > > Random access for blobs would be ideal, but even a

Re: [sqlite] Direct use of SQLite btree functions / performance

2006-04-20 Thread Christian Smith
On Wed, 19 Apr 2006, Joe Wilson wrote: >--- [EMAIL PROTECTED] wrote: >> Joe Wilson <[EMAIL PROTECTED]> wrote: >> > >> > If you read the blob all in at once, true. >> > But doesn't sqlite3BtreeData() allows you to read a partial chunk of >> > data from the blob at an arbitrary offset? This could

[sqlite] sqlite3_finalize() thread-safety (was: Re: [sqlite] Direct use of SQLite btree functions / performance)

2006-04-19 Thread Felix Schwarz
Am 19.04.2006 um 15:31 schrieb [EMAIL PROTECTED]: Felix Schwarz <[EMAIL PROTECTED]> wrote: Hi, I have just discovered these old message on the SQLite Yahoo! Group: http://groups.yahoo.com/group/sqlite/message/2115 http://groups.yahoo.com/group/sqlite/message/2117 This does sound very

Re: [sqlite] Direct use of SQLite btree functions / performance

2006-04-19 Thread Joe Wilson
--- [EMAIL PROTECTED] wrote: > Joe Wilson <[EMAIL PROTECTED]> wrote: > > > > If you read the blob all in at once, true. > > But doesn't sqlite3BtreeData() allows you to read a partial chunk of > > data from the blob at an arbitrary offset? This could be advantageous > > if you are dealing with

Re: AW: [sqlite] Direct use of SQLite btree functions / performance

2006-04-19 Thread drh
[EMAIL PROTECTED] wrote: > Maybe I'm missing something here, but there should be an interface to page a > blob into memory. Especially for large blobs, this would make sense to me to > not load them into memory at once. > > If sqlite doesn't provide this already, it would probably make a lot of

AW: Re: [sqlite] Direct use of SQLite btree functions / performance

2006-04-19 Thread michael . ruck
Maybe I'm missing something here, but there should be an interface to page a blob into memory. Especially for large blobs, this would make sense to me to not load them into memory at once. If sqlite doesn't provide this already, it would probably make a lot of sense to include this

Re: [sqlite] Direct use of SQLite btree functions / performance

2006-04-19 Thread drh
Joe Wilson <[EMAIL PROTECTED]> wrote: > > If you read the blob all in at once, true. > But doesn't sqlite3BtreeData() allows you to read a partial chunk of > data from the blob at an arbitrary offset? This could be advantageous > if you are dealing with multi-megabyte blobs and do not

Re: [sqlite] Direct use of SQLite btree functions / performance

2006-04-19 Thread Joe Wilson
--- [EMAIL PROTECTED] wrote: > Felix Schwarz <[EMAIL PROTECTED]> wrote: > > Hi, > > > > I have just discovered these old message on the SQLite Yahoo! Group: > > > > http://groups.yahoo.com/group/sqlite/message/2115 > > http://groups.yahoo.com/group/sqlite/message/2117 > > > > This does sound

Re: [sqlite] Direct use of SQLite btree functions / performance

2006-04-19 Thread drh
Felix Schwarz <[EMAIL PROTECTED]> wrote: > Hi, > > I have just discovered these old message on the SQLite Yahoo! Group: > > http://groups.yahoo.com/group/sqlite/message/2115 > http://groups.yahoo.com/group/sqlite/message/2117 > > This does sound very interesting! If I simply want to store

[sqlite] Direct use of SQLite btree functions / performance

2006-04-19 Thread Felix Schwarz
Hi, I have just discovered these old message on the SQLite Yahoo! Group: http://groups.yahoo.com/group/sqlite/message/2115 http://groups.yahoo.com/group/sqlite/message/2117 This does sound very interesting! If I simply want to store binary data that I want to access via an index number again