[ 
https://issues.apache.org/jira/browse/LUCENE-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787609#action_12787609
 ] 

Robert Muir commented on LUCENE-1377:
-------------------------------------

Hi, maybe we could simplify some things here if we were to refine this issue as 
its described: maybe not all tokenstreams but just some.

Maybe just tokenstreams considered to be more 'core/stable' by solr should 
belong in lucene-contrib? 

I would think word delimiter filter at least, maybe html strip and synonyms too 
would belong in this category. maybe not the pattern tokenizer even though I 
think its duplicated effort... at least this would be a start?


> Add HTMLStripReader and WordDelimiterFilter from SOLR
> -----------------------------------------------------
>
>                 Key: LUCENE-1377
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1377
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Analysis
>    Affects Versions: 2.3.2
>            Reporter: Jason Rutherglen
>            Priority: Minor
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> SOLR has two classes HTMLStripReader and WordDelimiterFilter which are very 
> useful for a wide variety of use cases.  It would be good to place them into 
> core Lucene.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org

Reply via email to