[
https://issues.apache.org/jira/browse/LUCENE-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Smiley updated LUCENE-8332:
---------------------------------
Description:
Lets move and rename the CompletionTokenStream in the suggest module into the
analysis module renamed as ConcatenateGraphFilter. See comments in LUCENE-8323
leading to this idea. Such a TokenStream (or TokenFilter?) has several uses:
* for the suggest module
* by the SolrTextTagger for NER/ERD use cases – SOLR-12376
* for doing complete match search efficiently
It will need a factory – a TokenFilterFactory, even though we don't have a
TokenFilter based subclass of TokenStream.
It appears there is no back-compat concern in it suddenly disappearing from the
suggest module as it's marked experimental and it only seems to be public now
perhaps due to some technicality (it has package level constructors).
was:
Lets move and rename the CompletionTokenStream in the suggest module into the
analysis module renamed as ConcatenateGraphTokenStream. See comments in
LUCENE-8323 leading to this idea. Such a TokenStream (or TokenFilter?) has
several uses:
* for the suggest module
* by the SolrTextTagger for NER/ERD use cases – SOLR-12376
* for doing complete match search efficiently
It will need a factory – a TokenFilterFactory, even though we don't have a
TokenFilter based subclass of TokenStream.
It appears there is no back-compat concern in it suddenly disappearing from the
suggest module as it's marked experimental and it only seems to be public now
perhaps due to some technicality (it has package level constructors).
Summary: New ConcatenateGraphFilter (move/rename CompletionTokenStream)
(was: New ConcatenateGraphTokenStream (move/rename CompletionTokenStream))
> New ConcatenateGraphFilter (move/rename CompletionTokenStream)
> --------------------------------------------------------------
>
> Key: LUCENE-8332
> URL: https://issues.apache.org/jira/browse/LUCENE-8332
> Project: Lucene - Core
> Issue Type: New Feature
> Components: modules/analysis
> Reporter: David Smiley
> Assignee: David Smiley
> Priority: Major
> Fix For: 7.4
>
> Attachments: LUCENE-8332.patch, LUCENE-8332.patch, LUCENE-8332.patch
>
> Time Spent: 3h 20m
> Remaining Estimate: 0h
>
> Lets move and rename the CompletionTokenStream in the suggest module into the
> analysis module renamed as ConcatenateGraphFilter. See comments in
> LUCENE-8323 leading to this idea. Such a TokenStream (or TokenFilter?) has
> several uses:
> * for the suggest module
> * by the SolrTextTagger for NER/ERD use cases – SOLR-12376
> * for doing complete match search efficiently
> It will need a factory – a TokenFilterFactory, even though we don't have a
> TokenFilter based subclass of TokenStream.
> It appears there is no back-compat concern in it suddenly disappearing from
> the suggest module as it's marked experimental and it only seems to be public
> now perhaps due to some technicality (it has package level constructors).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
