Re: [sqlite] LSM1 extension

2017-08-09 Thread Richard Hipp
On 8/9/17, Jens Alfke wrote: > > One thing I’m unclear on: Will the LSM1 extension in SQLite3 be able to plug > in at a low level (replacing the b-tree engine), so one can use it with all > the existing features like relational tables and SQL queries; or will it > provide only a basic key/value st

Re: [sqlite] LSM1 extension

2017-08-09 Thread Jens Alfke
> On Aug 9, 2017, at 8:23 AM, Nico Williams wrote: > > I must say though, SQLite4 is *brilliant*. I do hope that it either > gets completed and replaces SQLite3, or has all its good ideas folded > into SQLite3. The LSM1 work in SQLite3 seems to point towords the > latter. One thing I’m unclea

Re: [sqlite] LSM1 extension

2017-08-09 Thread Nico Williams
On Wed, Aug 09, 2017 at 08:26:51AM -0500, Charles Leifer wrote: > sqlite4's future is uncertain. It's not, as I understand, meant to replace > sqlite3 any time soon. I think it was more of a place to try out new ideas > for implementations. I must say though, SQLite4 is *brilliant*. I do hope tha

Re: [sqlite] LSM1 extension

2017-08-09 Thread Charles Leifer
Leifer<mailto:colei...@gmail.com> > Sent: 08 August 2017 21:21 > To: SQLite mailing list<mailto:sqlite-users@mailinglists.sqlite.org> > Subject: Re: [sqlite] LSM1 extension > > There's some information that may be of interest on the sqlite4 wiki: > > * Design

Re: [sqlite] LSM1 extension

2017-08-09 Thread x
Thanks Charles. Is sqlite4 available yet? From: Charles Leifer<mailto:colei...@gmail.com> Sent: 08 August 2017 21:21 To: SQLite mailing list<mailto:sqlite-users@mailinglists.sqlite.org> Subject: Re: [sqlite] LSM1 extension There's some information that may be of interest on

Re: [sqlite] LSM1 extension

2017-08-08 Thread Charles Leifer
viously my interest is much greater than that of the average SQLite user :) On Tue, Aug 8, 2017 at 12:54 PM, x wrote: > Thanks Richard. > > From: Richard Hipp<mailto:d...@sqlite.org> > Sent: 08 August 2017 18:47 > To: SQLite mailing list<mailto:sqlite-users@mailinglists.sqlite

Re: [sqlite] LSM1 extension

2017-08-08 Thread x
Thanks Richard. From: Richard Hipp<mailto:d...@sqlite.org> Sent: 08 August 2017 18:47 To: SQLite mailing list<mailto:sqlite-users@mailinglists.sqlite.org> Subject: Re: [sqlite] LSM1 extension On 8/8/17, x wrote: > I keep reading about this LSM1 but can’t find anything about it b

Re: [sqlite] LSM1 extension

2017-08-08 Thread Richard Hipp
On 8/8/17, x wrote: > I keep reading about this LSM1 but can’t find anything about it beyond > tickets. Any links? Baseline technology: https://en.wikipedia.org/wiki/Log-structured_merge-tree No documentation yet on the LSM1 implementation in SQLite. -- D. Richard Hipp d...@sqlite.org

Re: [sqlite] LSM1 extension

2017-08-08 Thread x
I keep reading about this LSM1 but can’t find anything about it beyond tickets. Any links? From: Jens Alfke<mailto:j...@mooseyard.com> Sent: 08 August 2017 18:04 To: SQLite mailing list<mailto:sqlite-users@mailinglists.sqlite.org> Subject: Re: [sqlite] LSM1 extension > On Aug 4

Re: [sqlite] LSM1 extension

2017-08-08 Thread Jens Alfke
> On Aug 4, 2017, at 9:12 PM, Charles Leifer wrote: > > Right -- my question is still unanswered as to why the code was merged in. It’s not uncommon in software engineering to put unfinished long-running feature work on the main development branch but disable it with a flag. (It was standard

Re: [sqlite] LSM1 extension

2017-08-05 Thread Richard Hipp
On 8/5/17, Charles Leifer wrote: > Right -- my question is still unanswered as to why the code was merged in. The code was merged due to bad planning. We thought LSM1 would be ready in time for 3.20.0, but we underestimated the amount of work involved in getting it there, and also the amount of

Re: [sqlite] LSM1 extension

2017-08-04 Thread Charles Leifer
Right -- my question is still unanswered as to why the code was merged in. I have tremendous respect for this project and everyone involved in it, so please understand I'm not trying to call into question your decisions -- I'd just like clarification as to why this was included now? On Fri, Aug 4,

Re: [sqlite] LSM1 extension

2017-08-04 Thread Richard Hipp
On 8/4/17, Charles Leifer wrote: > > My excitement quickly turned to disappointment as I realized that the > extension is unusable for all practical purposes: > Yes, it needs work. That is why it is unannounced. -- D. Richard Hipp d...@sqlite.org ___

[sqlite] LSM1 extension

2017-08-04 Thread Charles Leifer
Hi, I was pleased to see that 3.20 contained the source for the LSM1 virtual table, even if not included in the official announcements. My excitement quickly turned to disappointment as I realized that the extension is unusable for all practical purposes: - Single-key equality lookups are broken

Re: [sqlite] lsm1 extension

2017-06-20 Thread Charles Leifer
Thanks for the clarification! On Tue, Jun 20, 2017 at 2:41 AM Dan Kennedy wrote: > On 06/20/2017 12:42 PM, Charles Leifer wrote: > > Hi, > > > > I'm not quite sure of the proper way to compile the lsm1 extension (in > the > > lsm-vtab branch). I ended up hand-hacking the makefile to replace $(TC

Re: [sqlite] lsm1 extension

2017-06-20 Thread Dan Kennedy
On 06/20/2017 12:42 PM, Charles Leifer wrote: Hi, I'm not quite sure of the proper way to compile the lsm1 extension (in the lsm-vtab branch). I ended up hand-hacking the makefile to replace $(TCCX) and add the appropriate flags for gcc (-fPIC) to get it to build. I'd like to do it the "right wa

[sqlite] lsm1 extension

2017-06-19 Thread Charles Leifer
Hi, I'm not quite sure of the proper way to compile the lsm1 extension (in the lsm-vtab branch). I ended up hand-hacking the makefile to replace $(TCCX) and add the appropriate flags for gcc (-fPIC) to get it to build. I'd like to do it the "right way", though, as I was hoping to share some instru