[ 
https://issues.apache.org/jira/browse/LUCENE-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16452431#comment-16452431
 ] 

Mike Sokolov edited comment on LUCENE-8273 at 4/25/18 3:10 PM:
---------------------------------------------------------------

{quote}I'm not sure that this makes sense in those cases though? For example, 
what if the first token in the tokenstream matches the condition and is passed 
to the ShingleFilter, but the second one doesn't?{quote}
Hmm right. Well you might be able to use that idea to detect illegal states at 
least


was (Author: sokolov):
Hmm right. Well you might be able to use that idea to detect illegal states at 
least

> Add a ConditionalTokenFilter
> ----------------------------
>
>                 Key: LUCENE-8273
>                 URL: https://issues.apache.org/jira/browse/LUCENE-8273
>             Project: Lucene - Core
>          Issue Type: New Feature
>            Reporter: Alan Woodward
>            Priority: Major
>         Attachments: LUCENE-8273.patch, LUCENE-8273.patch
>
>
> Spinoff of LUCENE-8265.  It would be useful to be able to wrap a TokenFilter 
> in such a way that it could optionally be bypassed based on the current state 
> of the TokenStream.  This could be used to, for example, only apply 
> WordDelimiterFilter to terms that contain hyphens.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to