Re: Full text search - is it coming? If yes, approx when.

2011-04-02 Thread Robert Dionne
Yes, I agree wholeheartedly with this view. I would go further and speculate (as I haven't kept up with Lucene features) that Lucene is still primarily focused on lexical techniques and any real NLP functionality is done in Lucene plugins. The core idea in FTI is easy, an inverted index. Quick a

Re: Full text search - is it coming? If yes, approx when.

2011-03-29 Thread David Hardtke
Hi All, If we're discussing a native CouchDB full text search, I'd like to point out a few things about Cloudant's implementation that might guide the design. Our search indexing strategy is discussed here: http://support.cloudant.com/kb/search/search-indexing What we've opted to do is borr

Re: Full text search - is it coming? If yes, approx when.

2011-03-29 Thread Albin Stigo
Couchdb + Lucene (Elasticsearch etc.) is a really great combination and definitely enough on the server side... IMHO what is missing is a full text engine for Couchdb on mobile - that would be a killer... Currently the only full text search library on mobile devices is sqlite fts3 which is great bu

Re: Full text search - is it coming? If yes, approx when.

2011-03-29 Thread Norman Barker
Benoit, interesting post on Lucy, I have been monitoring that as well (and though no where near as good as Robert's work) I have integrated clucene and couchdb as I was looking for a solution that didn't use Java. I see a trend with couchdb and NIFs, what is the official standpoint here, test and

Re: Full text search - is it coming? If yes, approx when.

2011-03-29 Thread Simon Metson
Does http://blog.cloudant.com/developer-preview-cloudant-search-for-couchdb/ help wrt. the original post? Cloudant's search is built on Lucene. Cheers Simon Sent with Sparrow On Tuesday, 29 March 2011 at 14:24, Dennis Geurts wrote: Hi all, > > Looking at the amount of replies wrt to this topic

Re: Full text search - is it coming? If yes, approx when.

2011-03-29 Thread Dennis Geurts
Hi all, Looking at the amount of replies wrt to this topic it seems there's much interest in full text searching. It's really hard to tell how one would expect this feature to be implemented in couchdb in such a way that it would supersede the nice couchdb-lucene combo. That said, if you want

RE: Full text search - is it coming? If yes, approx when.

2011-03-29 Thread Zdravko Gligic
I have a bit tricky use case of super tagging or rather a somewhat hierarchical docs categorization. Several CouchDB gurus have suggested that I should look at Lucene and such. My problem is hosting because I would most rather go with a cloud solution such as Cloudant and forthcoming (I hope it's

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Gerardo Di Iorio
hi, this is an impletation of fts in erlang with couchdb https://github.com/bdionne/bitstore/tree/master/src/search/ 2011/3/28 Andrew Stuart (SuperCoders) : > It would be good to know if full text search is coming as a core feature and > if yes, approximately when - does anyone know? > > Even an a

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Benoit Chesneau
Would be cool to have a nifs integration of Apache Lucy. It may solve the problem. - benoit On Mon, Mar 28, 2011 at 5:17 PM, Olafur Arason wrote: > I love the power of Lucene but it's not needed for many usecases > and can even be gutted like Cloudant is doing with their search > using the lexer

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Robert Newson
Hi Martin, That's very kind, thank you. :) B. On 28 March 2011 16:16, Martin Hewitt wrote: > Bit off-topic Robert, but CouchDB-lucene really is superb, we use it > extensively and it's just brilliant, so thanks for contributing it to the > Couch community. > > Martin > > On 28 Mar 2011, at 15

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Olafur Arason
I love the power of Lucene but it's not needed for many usecases and can even be gutted like Cloudant is doing with their search using the lexer from Lucene. But most of the time people need quick and dirty search and even search integration with views. Then you would maybe have a really simple le

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Martin Hewitt
Bit off-topic Robert, but CouchDB-lucene really is superb, we use it extensively and it's just brilliant, so thanks for contributing it to the Couch community. Martin On 28 Mar 2011, at 15:30, Robert Newson wrote: > I am a CouchDB committer and author of couchdb-lucene. :) > > B. > > On 28

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Robert Newson
I am a CouchDB committer and author of couchdb-lucene. :) B. On 28 March 2011 10:44, Andrew Stuart (SuperCoders) wrote: > Hi Robert > > "there are no publicly known plans to build a native full-text indexing > feature for CouchDB." > > I don't know who is who around here as yet - are you comment

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Gabor Ratky
look at couchdb-lucene. it's worked flawlessly for us and its a rock solid integration of two separate technologies: https://github.com/rnewson/couchdb-lucene If you're on a mac dev box, you're one 'brew install couchdb-lucene' away, granted that you installed lucene with Homebrew as well (it w

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Luciano Ramalho
On Mon, Mar 28, 2011 at 8:16 AM, Benoit Chesneau wrote: > CouchBase != CouchDB. CouchBase is using couchdb burt couchdb itself > is a full opensource project. Thanks, Benoit, I do undestand that. It's a bit confusing, though, because all the other CouchDB features mentioned in the previous Couch

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Benoit Chesneau
On Mon, Mar 28, 2011 at 1:14 PM, Luciano Ramalho wrote: > On Mon, Mar 28, 2011 at 6:24 AM, Robert Newson > wrote: >> To answer the original post, there are no publicly known plans to >> build a native full-text indexing feature for CouchDB. > > Was there a change of plans? > > Because before bec

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Benoit Chesneau
On Mon, Mar 28, 2011 at 6:31 AM, Andrew Stuart (SuperCoders) wrote: > It would be good to know if full text search is coming as a core feature and > if yes, approximately when - does anyone know? > > Even an approximate timeframe would be good. > > thanks > As far as I know there is nothing plann

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Luciano Ramalho
On Mon, Mar 28, 2011 at 6:24 AM, Robert Newson wrote: > To answer the original post, there are no publicly known plans to > build a native full-text indexing feature for CouchDB. Was there a change of plans? Because before becoming Couchbase, the front page o CouchOne.com had a short list of maj

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Robert Dionne
Yes this would be a great feature. I've made some modest progress[1], based on the examples in the erlang book, on native FTI. I'm very keen on it as my use case isn't handled by Lucene. I've used both bitcask[2] and couchdb for storage of the inverted indices but neither seem well suited for som

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Andrew Stuart (SuperCoders)
Although it may be a huge amount of work, it would still seem to be a necessary feature for the core developers to build? It seems a fairly reasonable thing to expect a database could return records that contain "java OR C#" in a "subject line" field, without resorting to external software.

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Andrew Stuart (SuperCoders)
Hi Robert "there are no publicly known plans to build a native full-text indexing feature for CouchDB." I don't know who is who around here as yet - are you commenting from inside knowledge or as an end user/developer? Thanks On 28/03/2011, at 8:24 PM, Robert Newson wrote: I have to di

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Robert Newson
I have to dispute "There does not seem to be much understanding that this could be a killer feature." Obviously full-text search is a killer feature, but it's trivially available now via couchdb-lucene or elasticsearch. What people are asking for is native full-text search which, to me, is essent

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Olafur Arason
There does not seem to be much understanding that this could be a killer feature. People are now relying on Lucene which monitors the _changes feed. Cloudant has done it's own implementation which I gather through the information they have published makes a view out of all your word, they recommen

Re: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread Robert Johnson
If you are looking to implement full text search then I would suggest trying ElasticSearch using the River plugin. It does full text and tons of other clever auto indexing stuff. It's very ready to install. Bob Johnson "Andrew Stuart (SuperCoders)" wrote: >It would be good to know if full tex

RE: Full text search - is it coming? If yes, approx when.

2011-03-28 Thread deci...@gmail.com
Hi there, you might to have a look at elasticsearch and its couchdb river. Cheers E -Original message- From: Andrew Stuart (SuperCoders) Sent: 28/03/2011, 06:31 To: user@couchdb.apache.org Subject: Full text search - is it coming? If yes, approx when. It would be good to know if full