[
https://issues.apache.org/jira/browse/LUCENE-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13542880#comment-13542880
]
Uwe Schindler commented on LUCENE-4655:
---------------------------------------
Hi,
this interface is not for public use, it is internal only, but public to be
accessible from the various sub packages. To use StandardTokenizer, use its
public API from class StandardTokenizer whith attributes, calling
incrementToken(). The javadocs in the internal interface are only copied from
javacc's generated class.
> Documentation of the StandardTokenizerInterface getNextToken() return value
> ---------------------------------------------------------------------------
>
> Key: LUCENE-4655
> URL: https://issues.apache.org/jira/browse/LUCENE-4655
> Project: Lucene - Core
> Issue Type: Bug
> Components: general/javadocs
> Affects Versions: 4.0, 3.6.2
> Reporter: Juha Haaga
> Priority: Minor
> Labels: docs
>
> Documentation of getNextToken() says that it returns an int, but incorrectly
> states that it returns the next token. getNextToken doesn't return the next
> token, it returns the numerical type of the next token that was found, as
> defined by constants in the implementing class. That is also useful
> information that can be taken advantage of in the filtering chain that
> follows.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
