[ http://issues.apache.org/jira/browse/LUCENE-537?page=comments#action_12414889 ]
Otis Gospodnetic commented on LUCENE-537: ----------------------------------------- Not sure if you saw LUCENE-285, but I thought I'd point it out. I think that code was never committed. > Refactor of spell check > ----------------------- > > Key: LUCENE-537 > URL: http://issues.apache.org/jira/browse/LUCENE-537 > Project: Lucene - Java > Type: Improvement > Reporter: Karl Wettin > Attachments: lucene_spellcheck.tar.gz, ngram_spellcheck_karl_v3.tar > > I use the same ngram index for multiple categories, but only want to spell > check per category. The old implementation did not support this as it used > docFreq as controller source. > The spell check returns suggestions with score and not just the suggested > word. > TokenFrequencyVector replace the IndexReader used for docFreq. > LuceneTokenFrequencyVector wraps an IndexReader and works just as the old > implementation. > LuceneQueryDictionary creates an ngram dictionary based on a query and not > the whole index. > MultiTokenFrequencyVector treats a number of TokenFrequencyVector:s as one. > I.e. for use when spell checking in multiple contexts. > TokenFrequencyVectorMap is a HashMap facade. Comes with static factory to > create the vector based on the the tokens in a specific field from a search. > I use the TokenFrequencyVectorMap to build one vector per category and > instanciate a MultiTokenFrequencyVector for each user query. Could probably > save a couple of clock ticks by buffering MultiVectors rather than creating > new once all the time. > Also it seems as the ngram-code might not be thread safe. This also include > the source in CVS. Have not succeded to prove it when when testing, only in > the live environment. Each instance of Spellchecker only suggest once. And it > takes quite some resources to create new instances of the spellchecker as it > is designed today. Might get back on that subject. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
