Re: Lockless commits -- great stuff!

2007-01-16 Thread Marvin Humphrey
On Jan 16, 2007, at 2:30 PM, robert engels wrote: What is the problem with implementing the KinoSearch model for Lucene? It seems this would solve nearly all of these issues in a very srtaightfoward way. It's a major undertaking, and the only developer sufficiently motivated thus far has

Re: Lockless commits -- great stuff!

2007-01-16 Thread robert engels
What is the problem with implementing the KinoSearch model for Lucene? It seems this would solve nearly all of these issues in a very srtaightfoward way. BTW, the KinoSearch model is nearly exactly what we did when we our original implementation of IndexReader/Writer wrote directly to JDBC.

Re: Lockless commits -- great stuff!

2007-01-16 Thread Marvin Humphrey
Late response... On Jan 12, 2007, at 3:02 AM, Michael McCandless wrote: Now that readers are read-only, I think it makes sense to default the write lock into the index directory, and as you describe, no longer generate a "unique namespace" hash lock ID since the index dir gives us that scoping.

Re: Lockless commits -- great stuff!

2007-01-12 Thread Doug Cutting
Marvin Humphrey wrote: I'm writing a lot of KS 0.20 code with the notion that it will be submitted to Lucy [ ... ] Friendly reminder: if this is going to be eventually contributed to Apache, you need to make sure that all contributions can be under Apache's CLA. This would be simplest if yo

Re: Lockless commits -- great stuff!

2007-01-12 Thread Yonik Seeley
On 1/12/07, Michael McCandless <[EMAIL PROTECTED]> wrote: Now that readers are read-only, I think it makes sense to default the write lock into the index directory, and as you describe, no longer generate a "unique namespace" hash lock ID since the index dir gives us that scoping. +1 Are ther

Re: Lockless commits -- great stuff!

2007-01-12 Thread Michael McCandless
Marvin Humphrey wrote: On Jan 11, 2007, at 6:48 AM, Michael McCandless wrote: I too am happy that we have no more commit lock :) Not just that. :) No more lock directory, since we can put write.lock in the index directory itself. No more lock file name munging, since lock files from dif

Re: Lockless commits -- great stuff!

2007-01-11 Thread Marvin Humphrey
On Jan 11, 2007, at 6:48 AM, Michael McCandless wrote: I too am happy that we have no more commit lock :) Not just that. :) No more lock directory, since we can put write.lock in the index directory itself. No more lock file name munging, since lock files from different indexes no lon

Re: Lockless commits -- great stuff!

2007-01-11 Thread Michael McCandless
Marvin Humphrey wrote: I've finished integrating the lockless commits concept into KinoSearch, and I wanted to pop in and say that it's a very nice piece of work. Real outside-the-box thinking -- or at least outside my box. :) Nothing better than an innovation which solves long-standing pro

Lockless commits -- great stuff!

2007-01-10 Thread Marvin Humphrey
Greets, I've finished integrating the lockless commits concept into KinoSearch, and I wanted to pop in and say that it's a very nice piece of work. Real outside-the-box thinking -- or at least outside my box. :) Nothing better than an innovation which solves long- standing problems AND