See my comment on the issue. You should not consume token streams on construction.
----- Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: [email protected] > -----Original Message----- > From: Mattmann, Chris A (388J) [mailto:[email protected]] > Sent: Saturday, September 03, 2011 6:18 AM > To: [email protected] > Cc: [email protected]; [email protected] > Subject: Re: Analyzers and sorting with a custom analysis chain > > On Sep 2, 2011, at 8:53 PM, Mattmann, Chris A (388J) wrote: > > > > > I think in spelling this out though, I might have elaborated my > > problem. Since the method I call in the constructor for my > > CombiningFilter is super(mergeStreamTokens(in)) where > > mergeStreamTokens is a static method, I think I might have consumed > > the input TokenStream by the time it gets called for the sort. It works on > analysis.jsp probably because the stream isn't re-consumed? Not sure, > something wiggy is going on. > > OK scratch that. B/c I was creating a new KeywordTokenizer and then returning > that as the *new* input TokenStream, it was creating a new stream that could > be consumed via incrementToken, so that wasn't it. Must be something else. > > Will keep digging. > > Cheers, > Chris > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > ++ > Chris Mattmann, Ph.D. > Senior Computer Scientist > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA > Office: 171-266B, Mailstop: 171-246 > Email: [email protected] > WWW: http://sunset.usc.edu/~mattmann/ > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > ++ > Adjunct Assistant Professor, Computer Science Department University of > Southern California, Los Angeles, CA 90089 USA > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > ++ > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] For additional > commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
