Re: Using Lucene's payload in Solr

2009-08-12 Thread Grant Ingersoll
On Aug 11, 2009, at 5:30 PM, Bill Au wrote: It looks like things have changed a bit since this subject was last brought up here. I see that there are support in Solr/Lucene for indexing payload data (DelimitedPayloadTokenFilterFactory and DelimitedPayloadTokenFilter). Overriding the Simil

RE: Using Lucene's payload in Solr

2009-08-13 Thread Ensdorf Ken
> > It looks like things have changed a bit since this subject was last > > brought > > up here. I see that there are support in Solr/Lucene for indexing > > payload > > data (DelimitedPayloadTokenFilterFactory and > > DelimitedPayloadTokenFilter). > > Overriding the Similarity class is straight f

Re: Using Lucene's payload in Solr

2009-08-13 Thread Bill Au
Thanks for the tip on BFTQ. I have been using a nightly build before that was committed. I have upgrade to the latest nightly build and will use that instead of BTQ. I got DelimitedPayloadTokenFilter to work and see that the terms and payload of the field are correct but the delimiter and payloa

Re: Using Lucene's payload in Solr

2009-08-13 Thread Grant Ingersoll
On Aug 13, 2009, at 11:58 AM, Bill Au wrote: Thanks for the tip on BFTQ. I have been using a nightly build before that was committed. I have upgrade to the latest nightly build and will use that instead of BTQ. I got DelimitedPayloadTokenFilter to work and see that the terms and payloa

Re: Using Lucene's payload in Solr

2009-08-13 Thread Bill Au
I need to boost a field differently according to the content of the field. Here is an example: Solr information retrieval webapp xml Tomcat webapp XMLSpy xml ide A seach on category:webapp should return Tomcat before Solr. A search on category:xml should return XMLSpy befor

Re: Using Lucene's payload in Solr

2009-08-14 Thread Bill Au
Thanks for sharing your code, Ken. It is pretty much the same code that I have written except that my custom QueryParser extends Solr's SolrQueryParser instead of Lucene's QueryParser. I am also using BFTQ instead of BTQ. I have tested it and do see the payload being used in the explain output.

Re: Using Lucene's payload in Solr

2009-08-20 Thread Chris Hostetter
: of the field are correct but the delimiter and payload are stored so they : appear in the response also. Here is an example: ... : I am thinking maybe I can do this instead when indexing: : : XML for indexing: : Solr In Action : : This will simplify indexing as I don't have to repeat

Re: Using Lucene's payload in Solr

2009-08-21 Thread Bill Au
I ended up not using an XML attribute for the payload since I need to return the payload in query response. So I ended up going with: 2.0|Solr In Action My payload is numeric so I can pick a non-numeric delimiter (ie '|'). Putting the payload in front means I don't have to worry about the delimi

Re: Using Lucene's payload in Solr

2009-08-26 Thread Bill Au
While testing my code I discovered that my copyField with PatternTokenize does not do what I want. This is what I am indexing into Solr: 2.0|Solr In Action My copyField is simply: field titleRaw is of type title_raw: For my example

Re: Using Lucene's payload in Solr

2009-09-01 Thread Chris Hostetter
: Is it possible to have the copyField strip off the payload while it is : copying since doing it in the analysis phrase is too late? Or should I : start looking into using UpdateProcessors as Chris had suggested? "nope" and "yep" I've had an idea in the back of my mind ofr a while now about add