Re: Question about PatternReplace filter and automatic Synonym generation

2009-10-12 Thread Chris Hostetter
: There is a Solr.PatternTokenizerFactory class which likely fits the bill in : this case. The related question I have is this - is it possible to have : multiple Tokenizers in your analysis chain? No .. Tokenizers consume CharReaders and produce a TokenStream ... what's needed here is a TokenF

Re: Question about PatternReplace filter and automatic Synonym generation

2009-10-07 Thread Prasanna Ranganathan
On 10/6/09 3:32 PM, "Chris Hostetter" wrote: > > : I ll try to explain with an example. Given the term 'it!' in the title, it > : should match both 'it' and 'it!' in the query as an exact match. Currently, > : this is done by using a synonym entry (and index time SynonymFilter) as > : follow

Re: Question about PatternReplace filter and automatic Synonym generation

2009-10-06 Thread Chris Hostetter
: I ll try to explain with an example. Given the term 'it!' in the title, it : should match both 'it' and 'it!' in the query as an exact match. Currently, : this is done by using a synonym entry (and index time SynonymFilter) as : follows: : : it! => it, it! : : Now, the above holds true for

Re: Question about PatternReplace filter and automatic Synonym generation

2009-10-05 Thread Prasanna Ranganathan
On 10/5/09 8:59 PM, "Christian Zambrano" wrote: > > Wouldn't it be better to use built-in token filters at both index and > query that will convert 'it!' to just 'it'? I believe the > WorkDelimeterFilterFactory will do that for you. > We do have a field that uses WordDelimiterFilter but it a

Re: Question about PatternReplace filter and automatic Synonym generation

2009-10-05 Thread Christian Zambrano
Prasanna, Wouldn't it be better to use built-in token filters at both index and query that will convert 'it!' to just 'it'? I believe the WorkDelimeterFilterFactory will do that for you. Christian On Oct 5, 2009, at 7:31 PM, Prasanna Ranganathan > wrote: On 10/5/09 2:46 AM, "Shalin S

Re: Question about PatternReplace filter and automatic Synonym generation

2009-10-05 Thread Prasanna Ranganathan
On 10/5/09 2:46 AM, "Shalin Shekhar Mangar" wrote: >> Alternatively, is there a filter available which takes in a pattern and >> produces additional forms of the token depending on the pattern? The use >> case I am looking at here is using such a filter to automate synonym >> generation. In ou

Re: Question about PatternReplace filter and automatic Synonym generation

2009-10-05 Thread Prasanna Ranganathan
I just saw the reply from Shalin after sending this email. Kindly excuse. On 10/5/09 5:17 PM, "Prasanna Ranganathan" wrote: > > Can someone please give me some pointers to the questions in my earlier > email? And and every help is much appreciated. > > Regards, > > Prasanna. > > > On 10/

Re: Question about PatternReplace filter and automatic Synonym generation

2009-10-05 Thread Prasanna Ranganathan
Can someone please give me some pointers to the questions in my earlier email? And and every help is much appreciated. Regards, Prasanna. On 10/2/09 11:01 AM, "Prasanna Ranganathan" wrote: > > Does the PatternReplaceFilter have an option where you can keep the original > token in addition

Re: Question about PatternReplace filter and automatic Synonym generation

2009-10-05 Thread Shalin Shekhar Mangar
On Fri, Oct 2, 2009 at 11:31 PM, Prasanna Ranganathan < pranganat...@netflix.com> wrote: > > Does the PatternReplaceFilter have an option where you can keep the > original token in addition to the modified token? From what I looked at it > does not seem to but I want to confirm the same. > > No,

Question about PatternReplace filter and automatic Synonym generation

2009-10-02 Thread Prasanna Ranganathan
Does the PatternReplaceFilter have an option where you can keep the original token in addition to the modified token? From what I looked at it does not seem to but I want to confirm the same. Alternatively, is there a filter available which takes in a pattern and produces additional forms of the