[
https://issues.apache.org/jira/browse/LUCENE-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854903#action_12854903
]
Uwe Schindler commented on LUCENE-2384:
---------------------------------------
For JFlex this does not help as the Jflex-generated code always needs a Reader.
This is special here, the lexer will not need to load the whole document into
the reader, it only needs sometimes a large look forward/backwards buffer.
> Reset zzBuffer in StandardTokenizerImpl* when lexer is reset.
> -------------------------------------------------------------
>
> Key: LUCENE-2384
> URL: https://issues.apache.org/jira/browse/LUCENE-2384
> Project: Lucene - Java
> Issue Type: Sub-task
> Components: Analysis
> Affects Versions: 3.0.1
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
> Fix For: 3.1
>
>
> When indexing large documents, the lexer buffer may stay large forever. This
> sub-issue resets the lexer buffer back to the default on reset(Reader).
> This is done on the enclosing issue.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org
