org.apache.solr.analysis.BufferedTokenStream.java (that can peek n tokens ahead in the buffered input stream, without modifying the stream) and CommonGramsFilter.java may help.
--- On Sat, 10/16/10, Christoph Hermann <[email protected]> wrote: > From: Christoph Hermann <[email protected]> > Subject: Copying Payload from one Token to the next > To: [email protected] > Date: Saturday, October 16, 2010, 9:31 PM > Hello, > > how can i copy the Payload from the current token to the > following token in a > TokenFilter? > > I have implemented a TokenFilter and thought, that i could > use > input.incrementToken() to advance the stream to the next > token and just copy > the Payload to this next token. > But the problem with this approach is, that the token > automatically gets > consumed, so on the next run i only get the third token > (and so on). > > What would be the best way to copy a payload from the > current token to the > following ones? > > regards > Christoph Hermann > > PS: Thanks Uwe for the hint regarding scorePayload. That > helped me to identify > the problem above (the payload was not copied to all > elements). > > -- > Christoph Hermann > Institut für Informatik > Tel: +49 761-203-8171 Fax: +49 761-203-8162 > e-mail: [email protected] > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
