[ 
https://issues.apache.org/jira/browse/LUCENE-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16484065#comment-16484065
 ] 

Alan Woodward commented on LUCENE-8327:
---------------------------------------

Here's an initial patch sketching out the idea.  It still needs a filter 
factory and adding into CustomAnalyzer, and it would be nice to somehow add it 
into TestRandomChains.  A caveat is that I don't think this will work with 
tokenfilters that need to read ahead, like SynonymFilter.

> Add a multiplexing TokenFilter
> ------------------------------
>
>                 Key: LUCENE-8327
>                 URL: https://issues.apache.org/jira/browse/LUCENE-8327
>             Project: Lucene - Core
>          Issue Type: New Feature
>            Reporter: Alan Woodward
>            Assignee: Alan Woodward
>            Priority: Major
>         Attachments: LUCENE-8327.patch
>
>
> Following on from LUCENE-8273, and as a prerequisite of LUCENE-8308, it would 
> be useful to have a TokenFilter that takes a number of child filters, and 
> repeats its incoming stream, applying each filter in turn.  So for example, 
> you could keep the original term, output ngrams, and apply stemming, all in 
> the same token stream.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to