Hi ,
Yes. Analyzer was the culprit behind eating away some of the letters
in the search string . StandardAnalyser has 'a' and 's' as stop words
(amongst others).
Since i want to search on these (specifically , i want to search on
words like "a/s" , "e/p" , "15%" , " 15' " ..etc). so i commented the
following lines in StandardAnalyser .. (filtering of Standard tokens
and stop words)
public TokenStream tokenStream(String fieldName, Reader reader) {
TokenStream result = new StandardTokenizer(reader);
// result = new StandardFilter(result);
result = new LowerCaseFilter(result);
// result = new StopFilter(result, stopSet);
return result;
now stop words are not getting filtered but "/" still goes off.
so "a/s" is read as "a s"
Regards
Robin
On Thu, 27 Jan 2005 02:50:13 -0600, Chris Lamprecht
<[EMAIL PROTECTED]> wrote:
> Without looking at the source, my guess is that StandardAnalyzer (and
> StandardTokenizer) is the culprit. The StandardAnalyzer grammar (in
> StandardTokenizer.jj) is probably defined so "x/y" parses into two
> tokens, "x" and "y". "s" is a default stopword (see
> StopAnalyzer.ENGLISH_STOP_WORDS), so it gets filtered out, while "p"
> does not.
>
> To get what you want, you can use a WhitespaceAnalyzer, write your own
> custom Analyzer or Tokenizer, or modify the StandardTokenizer.jj
> grammar to suit your needs. WhitespaceAnalyzer is much simpler than
> StandardAnalyzer, so you may see some other things being tokenized
> differently.
>
> -Chris
>
> On Thu, 27 Jan 2005 12:12:16 +0530, Robinson Raju
> <[EMAIL PROTECTED]> wrote:
> > Hi ,
> >
> > Is there a way to search for words that contain "/" or "%" .
> > if my query is "test/s" , it is just taken as "test"
> > if my query is "test/p" , it is just taken as "test p"
> > has anyone done this / faced such an issue ?
> >
> > Regards
> > Robin
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: [EMAIL PROTECTED]
> > For additional commands, e-mail: [EMAIL PROTECTED]
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [EMAIL PROTECTED]
> For additional commands, e-mail: [EMAIL PROTECTED]
>
>
--
Regards,
Robin
9886394650
"The merit of an action lies in finishing it to the end"
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
