contrib: keywordTokenStream

2005-05-03 Thread Wolfgang Hoschek
Here's a convenience add-on method to MemoryIndex. If it turns out that this could be of wider use, it could be moved into the core analysis package. For the moment the MemoryIndex might be a better home. Opinions, anyone? Wolfgang. /** * Convenience method; Creates and returns a token

Re: contrib: keywordTokenStream

2005-05-03 Thread Wolfgang Hoschek
On May 3, 2005, at 5:26 PM, Erik Hatcher wrote: Wolfgang, I've now added this. Thanks :-) I'm not seeing how this could be generally useful. I'm curious how you are using it and why it is better suited for what you're doing than any other analyzer. keyword tokenizer is a bit overloaded