On Thu, Aug 20, 2009 at 12:37 PM, Matthew Toseland<toad at amphibian.dyndns.org> wrote: > On Sunday 16 August 2009 20:02:06 you wrote: >> I've put stopword support in Library, I think it behaves ideally in >> deciding when to alter a search containing stop words or when to >> reject it, except for not notifying the user if a stopword was removed >> from their query. >> >> For the moment I have only used 6 english stopwords : the, and, that, >> have, not, with >> >> Any suggestions on how many stop words should be used and stop words >> in other languages? > > Not sure.
but, for, you, his, her, she... Anything in the most common20-50 English words? >> I've put hard coded stop words in XMLSpider too, but it's on my fork >> git://github.com/platy/plugin-XMLSpider-staging.git there are a lot of >> commits on there which haven't been pushed to >> git://github.com/freenet/plugin-XMLSpider-staging.git ?I didn't push >> it as it will be incompatible with older versions due to changes in >> the database, should I push this stuff? > > Yes, if it's reasonably stable, increment the database version so the old > database gets moved out of the way. It should import the old database! At the very least, it needs to import the keys from the old database or old index files and re-download them if needed. Evan Daniel
