[ https://issues.apache.org/jira/browse/SOLR-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13058470#comment-13058470 ]
Dawid Weiss commented on SOLR-2628: ----------------------------------- Yep, this is a duplicate. Thanks Mike. Like I said -- I won't be able to work on this for the next two weeks (I also have that FST refactoring opened up in the background... it's progressing slowly), but it's definitely a low-hanging fruit to pick because it shouldn't be very difficult and the gains huge. > use of FST for SynonymsFilterFactory and synonyms.txt > ----------------------------------------------------- > > Key: SOLR-2628 > URL: https://issues.apache.org/jira/browse/SOLR-2628 > Project: Solr > Issue Type: New Feature > Components: Schema and Analysis > Affects Versions: 3.4, 4.0 > Environment: Linux > Reporter: Bernd Fehling > Assignee: Dawid Weiss > Priority: Minor > Labels: suggestion > > Currently the SynonymsFilterFactory builds up a memory based SynonymsMap. > This can generate huge maps because of the permutations for synonyms. > Now where FST (finite state transducer) is introduced to lucene this could > also be used for synonyms. > A tool can compile the synoynms.txt file to a binary automaton file which can > then be used > with SynoynmsFilterFactory. > Advantage: > - faster start of solr, no need to generate SynonymsMap > - faster lookup > - memory saving -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org