[
https://issues.apache.org/jira/browse/LUCENE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16541545#comment-16541545
]
ASF subversion and git services commented on LUCENE-8395:
---------------------------------------------------------
Commit 8997d41357ab95eaa88702b93c75de4b1813457b in lucene-solr's branch
refs/heads/master from [~romseygeek]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=8997d41 ]
LUCENE-8395: WordDelimiterGraphFilter can incorrectly add holes
> WordDelimiterGraphFilter can incorrectly add holes to a TokenStream
> -------------------------------------------------------------------
>
> Key: LUCENE-8395
> URL: https://issues.apache.org/jira/browse/LUCENE-8395
> Project: Lucene - Core
> Issue Type: New Feature
> Reporter: Alan Woodward
> Assignee: Alan Woodward
> Priority: Major
> Attachments: LUCENE-8395.patch
>
>
> If a token consists entirely of delimiter characters, then
> WordDelimiterGraphFilter will remove the token and insert a hole into the
> TokenStream. However, it does this even if {{preserve_original}} is set,
> which results in an extra gap being added to the stream.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
