[ 
https://issues.apache.org/jira/browse/ACCUMULO-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203212#comment-13203212
 ] 

Adam Fuchs commented on ACCUMULO-374:
-------------------------------------

Wikisearch does use Lucene parsers, so I guess it must make some sense. We're 
trying out the experimental 
org.apache.lucene.wikipedia.analysis.WikipediaTokenizer within 
org.apache.accumulo.examples.wikisearch.ingest.WikipediaMapper.
                
> wikisearch-ingest stop list should be removed
> ---------------------------------------------
>
>                 Key: ACCUMULO-374
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-374
>             Project: Accumulo
>          Issue Type: Bug
>            Reporter: Adam Fuchs
>            Assignee: Adam Fuchs
>             Fix For: 1.4.0
>
>
> Wikisearch-ingest's WikipediaMapper has a list of stop words that presumably 
> are supposed to be ignored (not indexed). This feature should be removed 
> because:
> 1. The StopFilter code does not work. Stop words are indexed anyway. Not sure 
> why.
> 2. Stop lists are not a significant performance concern with this type of 
> indexing. It's better for cross-language search, phrase search, and for 
> overall search efficiency not to use a stop list.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to