[ https://issues.apache.org/jira/browse/LUCENE-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554473 ]
Yonik Seeley commented on LUCENE-1101: -------------------------------------- Resetting tokens (including the position) is currently handled via Token.clear() before the consumer reuses a token. > Tokenizers should reset positionIncrement to 1 in their next(Token result) > --------------------------------------------------------------------------- > > Key: LUCENE-1101 > URL: https://issues.apache.org/jira/browse/LUCENE-1101 > Project: Lucene - Java > Issue Type: Bug > Affects Versions: 2.3 > Reporter: Doron Cohen > Assignee: Doron Cohen > Fix For: 2.3 > > Attachments: lucene-1101.patch > > > Tokenizers which implement the reuse form of the next method: > next(Token result) > should reset the postionIncrement of the returned token to 1. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]