[sqlite] Re: [Monotone-devel] [sqlite] disk locality (and delta storage)

2006-02-11 Thread drh
Daniel Carosone <[EMAIL PROTECTED]> wrote: > > > Just type (for example): > > > >monotone httpserver & > > > > and then point your webbrowser at 127.0.0.1. > > My personal favourite is jetty in Java for this kind of thing; I'm not > sure monotone itself should grow a http server :) The bu

[sqlite] Re: [Monotone-devel] [sqlite] disk locality (and delta storage)

2006-02-11 Thread Nathaniel Smith
On Fri, Feb 10, 2006 at 07:06:27PM -0500, [EMAIL PROTECTED] wrote: > Daniel Carosone <[EMAIL PROTECTED]> wrote: > > Wiki pages doesn't seem so hard, they're pretty much text documents > > stored in a VCS anyway. > > There are some complications. Each wiki page acts if it where > its own independ

[sqlite] Re: [Monotone-devel] Re: [sqlite] disk locality (and delta storage)

2006-02-11 Thread Nathaniel Smith
Thanks for this detailed email! I've been a bit crazy with codecon the last week, and most of what I have to say is "hmm, lots to think about here", so, yeah :-). I did want to reply to your VCS system comments, though: On Tue, Feb 07, 2006 at 10:17:54AM -0500, [EMAIL PROTECTED] wrote: > What I'

[sqlite] Re: [Monotone-devel] [sqlite] disk locality (and delta storage)

2006-02-10 Thread drh
Daniel Carosone <[EMAIL PROTECTED]> wrote: > > It seems a little odd to me to build a centralised, online > information system for tracking state and documenting activity around > and about source code in a distributed and disconnected VCS. > Ah yes, you're right. But in the system I envision

RE: [sqlite] disk locality (and delta storage)

2006-02-07 Thread DeMarco, Paul
: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Tuesday, February 07, 2006 7:18 AM To: sqlite-users@sqlite.org Cc: monotone-devel@nongnu.org Subject: Re: [sqlite] disk locality (and delta storage) Nathaniel Smith <[EMAIL PROTECTED]> wrote: > > So and rows are basically written to

Re: [sqlite] disk locality (and delta storage)

2006-02-07 Thread drh
Nathaniel Smith <[EMAIL PROTECTED]> wrote: > > So and rows are basically written to the file in the same order > that the INSERT statements are executed? Right. If there are no free pages in the database file (which is the usual case for Monotone, I expect) then new pages are allocated from the

Re: [sqlite] disk locality

2006-02-07 Thread Nathaniel Smith
On Wed, Feb 01, 2006 at 08:56:37PM -0800, Joe Wilson wrote: > Another question... Does Monotone still Base64 encode all its data before > putting it into blobs? > If so, using raw binary SQLite blobs would likely give Monotone a 33% speedup > and smaller > database. It does, actually, but that's

Re: [sqlite] disk locality (and delta storage)

2006-02-07 Thread Nathaniel Smith
Thanks for the helpful reply. Sorry I've taken so long to get back to this; I've had some hardware trouble and am only catching up on email now... On Wed, Feb 01, 2006 at 07:27:06AM -0500, [EMAIL PROTECTED] wrote: > Nathaniel Smith <[EMAIL PROTECTED]> wrote: > > I was wondering if there were any

Re: [sqlite] disk locality

2006-02-01 Thread Joe Wilson
Another question... Does Monotone still Base64 encode all its data before putting it into blobs? If so, using raw binary SQLite blobs would likely give Monotone a 33% speedup and smaller database. --- Joe Wilson <[EMAIL PROTECTED]> wrote: > Does Monotone spend most of its database time in a few

Re: [sqlite] disk locality

2006-02-01 Thread Joe Wilson
Does Monotone spend most of its database time in a few long running queries or thousands of sub-second queries? Could you point us to an example monotone database tarball and give some actual examples of speed-deficient queries? When working with large SQLite databases with blobs I generally fi

Re: [sqlite] disk locality

2006-02-01 Thread drh
Nathaniel Smith <[EMAIL PROTECTED]> wrote: > I was wondering if there were any docs or explanations available on > how SQLite decides to lay out data on disk. Free pages in the middle of the file are filled first. Some effort is made to uses pages that are close together for related information.

[sqlite] disk locality

2006-02-01 Thread Nathaniel Smith
Hello, I was wondering if there were any docs or explanations available on how SQLite decides to lay out data on disk. The context is the monotone project -- http://venge.net/monotone -- a VCS where we store project history in a sqlite database. Sqlite has been _very_ good to us, and we'd rather