[
https://issues.apache.org/jira/browse/SOLR-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798188#action_12798188
]
Yonik Seeley commented on SOLR-1657:
------------------------------------
What about preserving the attributes for just the first token? That makes a
lot of sense in many cases (say when WDF is just removing punctuation).
So if preserveOriginal==true, the first token would always be the original.
This should also be the most performant since it's just a modification to the
first token (offset and termText)?
> convert the rest of solr to use the new tokenstream API
> -------------------------------------------------------
>
> Key: SOLR-1657
> URL: https://issues.apache.org/jira/browse/SOLR-1657
> Project: Solr
> Issue Type: Task
> Reporter: Robert Muir
> Attachments: SOLR-1657.patch, SOLR-1657.patch
>
>
> org.apache.solr.analysis:
> BufferedTokenStream
> -> -CommonGramsFilter-
> -> -CommonGramsQueryFilter-
> -> -RemoveDuplicatesTokenFilter-
> -CapitalizationFilterFactory-
> -HyphenatedWordsFilter-
> -LengthFilter (deprecated, remove)-
> SynonymFilter
> SynonymFilterFactory
> WordDelimiterFilter
> org.apache.solr.handler:
> AnalysisRequestHandler
> AnalysisRequestHandlerBase
> org.apache.solr.handler.component:
> QueryElevationComponent
> SpellCheckComponent
> org.apache.solr.highlight:
> DefaultSolrHighlighter
> org.apache.solr.search:
> FieldQParserPlugin
> org.apache.solr.spelling:
> SpellingQueryConverter
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
