[
https://issues.apache.org/jira/browse/SOLR-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12570024#action_12570024
]
Yonik Seeley commented on SOLR-330:
-----------------------------------
{quote}WordDelimiterFilter, as there is a fair amount of new token creation,
Also, I think, the newTok() method doesn't set the position increment based on
the original position increment, so I added that.{quote}
Careful, that might introduce a bug... the position increments in WDF are
generally set elsewhere, and setting it in newTok might cause more than one
token to get that increment.
> Use new Lucene Token APIs (reuse and char[] buff)
> -------------------------------------------------
>
> Key: SOLR-330
> URL: https://issues.apache.org/jira/browse/SOLR-330
> Project: Solr
> Issue Type: Improvement
> Reporter: Yonik Seeley
> Assignee: Grant Ingersoll
> Priority: Minor
> Attachments: SOLR-330.patch
>
>
> Lucene is getting new Token APIs for better performance.
> - token reuse
> - char[] offset + len instead of String
> Requires a new version of lucene.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
