Re: Tokenizer

2020-03-19 Thread Andi Vajda
On Thu, 19 Mar 2020, Marc Jeurissen wrote: Pylucene version: 8.1.1 Hi all, When you have a custom tokenizer (class CustomTokenizer(PythonTokenizer)), you don?t seem to be able to override any method besides incrementToken (so not end, reset, close). Is this correct? Correct, the only

Tokenizer

2020-03-19 Thread Marc Jeurissen
Pylucene version: 8.1.1 Hi all, When you have a custom tokenizer (class CustomTokenizer(PythonTokenizer)), you don’t seem to be able to override any method besides incrementToken (so not end, reset, close). Is this correct? Thank you very much Met vriendelijke groeten, Marc Jeurissen