KeywordTokenizer does not set start/end offset of the Token it produces
-----------------------------------------------------------------------
Key: LUCENE-1441
URL: https://issues.apache.org/jira/browse/LUCENE-1441
Project: Lucene - Java
Issue Type: Bug
Components: Analysis
Affects Versions: 2.4, 2.3.2, 2.3.1, 2.3
Reporter: Michael McCandless
Assignee: Michael McCandless
Priority: Minor
I think just adding these two lines in the next(Token) method is the right fix:
reusableToken.setStartOffset(0);
reusableToken.setEndOffset(upto);
I don't think this is a back compat issue because the start/end offset are now
meaningless since they will inherit whatever the reusable token had previously
been used for.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
